-- Logs begin at Tue 2022-09-06 15:32:18 UTC, end at Tue 2022-09-06 16:41:46 UTC. -- Sep 06 16:05:34.218297 dv-cinder-852208-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 16:05:34.228380 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 16:05:34 2022] *** Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: nodename: dv-cinder-852208-18-iscsi Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: machine: x86_64 Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: clock source: unix Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: pcre jit disabled Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: detected number of CPU cores: 4 Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: current working directory: / Sep 06 16:05:34.230396 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: detected binary path: /usr/bin/uwsgi-core Sep 06 16:05:34.231117 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: your processes number limit is 47680 Sep 06 16:05:34.231117 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: your memory page size is 4096 bytes Sep 06 16:05:34.231117 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: detected max file descriptor number: 2048 Sep 06 16:05:34.231117 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: lock engine: pthread robust mutexes Sep 06 16:05:34.231117 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: thunder lock: enabled Sep 06 16:05:34.231117 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 16:05:34.231117 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 16:05:34.278625 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: Python main interpreter initialized at 0x55737c8b59c0 Sep 06 16:05:34.278625 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: python threads support enabled Sep 06 16:05:34.278625 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: your server socket listen backlog is limited to 100 connections Sep 06 16:05:34.278625 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: your mercy for graceful operations on workers is 90 seconds Sep 06 16:05:34.279129 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 16:05:34.279218 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: *** Operational MODE: preforking *** Sep 06 16:05:34.279589 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: *** uWSGI is running in multiple interpreter mode *** Sep 06 16:05:34.279589 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: spawned uWSGI master process (pid: 105715) Sep 06 16:05:34.279766 dv-cinder-852208-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 16:05:34.284419 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: spawned uWSGI worker 1 (pid: 105724, cores: 1) Sep 06 16:05:34.284419 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: spawned uWSGI worker 2 (pid: 105726, cores: 1) Sep 06 16:05:34.284419 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 16:05:35.003244 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:05:35.058763 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:05:36.123294 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:05:36.123294 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: from cryptography.utils import int_from_bytes Sep 06 16:05:36.123929 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:05:36.123929 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: from cryptography.utils import int_from_bytes Sep 06 16:05:36.198991 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:05:36.198991 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: from cryptography.utils import int_from_bytes Sep 06 16:05:36.199575 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:05:36.199575 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: from cryptography.utils import int_from_bytes Sep 06 16:05:38.689573 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:05:38.690273 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:05:38.690619 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:05:38.690747 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:05:38.690833 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:05:38.690919 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:05:38.691009 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:05:38.691097 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:05:38.691182 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:05:38.691269 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:05:38.691400 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.691594 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.691727 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.691922 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.692050 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.692246 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.692370 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.692568 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.692707 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.692900 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.693018 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.693215 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.693339 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.693536 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.693656 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.693853 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.693981 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.694181 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.694268 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.694443 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.694530 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.694789 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.694878 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-18-iscsi {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.695116 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-18-iscsi {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.695215 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.695439 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.695529 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.695757 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.695898 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.696065 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.696163 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.696364 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.696455 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.696673 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.696771 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.696977 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.697061 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.697286 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.697474 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.697789 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.697904 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.698098 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.698199 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.698402 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.698492 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.698762 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.698881 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.699072 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.699182 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.699384 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.699470 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.699691 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.699778 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.700007 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.700092 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.700312 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.700406 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.700631 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.700726 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.700941 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.701039 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-18-iscsi {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.701333 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.701419 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-18-iscsi {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.701645 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.701742 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.701954 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.702086 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.702265 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.702351 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.702684 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.702787 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.703000 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.703084 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.703311 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.703406 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.703633 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.703727 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.703940 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.704041 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.704261 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.704357 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.704585 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.704677 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.704902 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.704992 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.705220 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.705307 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.705545 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.705631 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.705856 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.705968 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.706162 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.706280 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.706469 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.706573 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.706794 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.706889 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.707099 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.707194 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.707346 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.707439 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.707636 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.707728 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.707946 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.708040 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.708264 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.708357 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.708583 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.708683 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.708831 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709072 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709195 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709289 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709382 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709461 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709677 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709779 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.709982 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.710074 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.710289 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.710400 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.710597 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.710712 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.710929 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.711036 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.711234 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.711324 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.711537 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.711625 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.711840 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.711936 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.712145 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.712233 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.712451 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.712546 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.712767 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.712864 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.713081 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.713171 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.713387 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.713475 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.713695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.713801 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.714012 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.714102 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.714326 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.714414 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.714634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.714758 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.714978 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.715073 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.715300 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.715390 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.715609 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.715699 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.715914 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.716009 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.716233 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.716322 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.716543 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.716632 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.716848 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.716944 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.717151 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.717238 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.717458 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.717556 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.717775 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.717863 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.718077 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.718165 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.718337 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.718456 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.718628 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.718739 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.718952 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.719046 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.719259 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.719341 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.719564 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.719639 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.719870 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.719954 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.720177 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.720251 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.720475 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.720548 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.720774 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.720857 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.721608 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.721699 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.721912 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.721985 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.722215 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.722305 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.722521 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.722594 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.722851 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.722941 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.723159 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.723384 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.723482 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.723595 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.723756 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.723847 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.724059 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.724152 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.724362 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.724447 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.724681 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.724765 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.724989 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.725083 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.725308 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.725431 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.725597 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.725684 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.725900 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.725994 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.726206 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.726308 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.726510 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.726601 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.726858 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.726960 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.727204 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.727292 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.727470 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.727570 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.727781 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.727905 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.728093 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.728367 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.728451 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.728517 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.728667 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.728755 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.728973 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.729060 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.729273 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.729400 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.729578 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.729688 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.729884 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.729990 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.730188 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.730280 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.730491 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.730583 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.730812 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.730903 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.731113 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.731218 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.731413 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.731520 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.731714 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.731813 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732011 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732183 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732311 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732421 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732606 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732698 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732903 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.732997 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.733219 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.733308 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.733529 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.733612 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.733833 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.733929 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.734136 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.734227 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.734439 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.734523 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.734780 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:05:38.734870 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.735113 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.735198 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.735444 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.735575 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.735754 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.735840 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.736084 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.736171 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.736413 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.736501 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.737288 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.737386 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.737602 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.737695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.737915 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.738054 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.738239 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.738325 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.738550 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.738641 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.738885 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.738986 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.739194 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.739281 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.739514 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.739613 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.739830 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.739935 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.740146 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.740237 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.740459 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.740556 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.740773 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.740868 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.741085 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.741176 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.741393 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.741479 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.741702 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.741800 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.742023 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.742117 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.742342 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.742447 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.742646 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.742780 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.742979 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.743064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.743322 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.743409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.743649 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.743734 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.743968 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.744052 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.744287 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.744385 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.744600 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.744687 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.744909 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.744995 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.745218 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.745304 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.745526 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.745663 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.745861 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.745947 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.746173 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.746258 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.746490 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.746579 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.746824 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.746911 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.747145 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.747230 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.747461 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.747549 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.747772 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.747859 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.748083 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.748180 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.748393 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.748478 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.748704 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.748789 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.749015 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.749110 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.749338 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.749423 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.749654 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.749752 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.749966 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.750070 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.750279 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.750367 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.750589 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.750729 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.750927 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.751026 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.751238 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.751323 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.751545 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.751629 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.751853 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.751947 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.752185 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.752340 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.752558 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.752657 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.752795 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.752894 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.753104 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.753191 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.753424 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.753510 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.753750 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.753838 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.754059 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.754145 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.754376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.754461 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.754703 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.754793 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.755018 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.755114 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.755329 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.755504 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.755638 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.755772 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.755940 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.756026 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.756245 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.756344 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.756555 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.756640 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.756860 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.756953 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.757165 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.757264 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.757481 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.757573 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.757788 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.757874 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.758094 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.758226 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.758403 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.758488 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.758731 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.758821 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.759041 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.759128 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.759352 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.759437 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.759668 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.759790 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.759979 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.760080 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.760290 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.760395 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.760601 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.760697 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.760914 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.761008 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.761225 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.761327 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.761538 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.761639 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.761872 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.761966 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.762176 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.762277 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.762499 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.762599 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.762851 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.762946 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.763167 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.763258 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.763471 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.763574 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.763772 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.763864 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.764073 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.764166 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.764375 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.764481 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.764676 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.764768 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.764982 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.765076 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.765285 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.765394 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.765587 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.765688 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.765888 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.765980 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.766190 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.766285 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.766511 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.766616 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.766820 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.766909 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.767143 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.767240 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.767448 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.767543 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.767749 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.767839 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.768102 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.768263 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.768473 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.768563 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.768822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.768911 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.769130 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.769266 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.769470 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.769602 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.769812 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.769912 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.770134 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.770223 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.770457 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.770548 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.770798 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.770902 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.771118 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.771208 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.771429 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.771519 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.771743 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.771843 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.772057 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.772147 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.772370 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.772460 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.772680 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.772778 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.772990 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.773078 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.773307 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.773395 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.773614 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.773717 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.773933 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.774022 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.774245 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.774335 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.774550 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.774640 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.774895 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.774987 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.775212 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.775318 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.775556 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.775646 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.775872 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.775961 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.776195 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.776285 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.776526 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.776666 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.776825 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.776927 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.777133 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.777228 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.777441 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.777529 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.777751 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.777840 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.778061 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.778178 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.778375 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.778473 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.778702 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.778862 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.779025 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.779177 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.779335 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.779516 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.779652 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.779798 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.779957 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.780108 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.780269 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.780423 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.780558 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.780691 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.780873 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.781024 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.781188 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.781330 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.781526 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.781667 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.781833 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.781992 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.782135 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.782281 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.782453 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.782602 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.782780 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.782918 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.783092 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.783233 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.783433 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.784061 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.784237 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.784452 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.784671 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.784897 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.785118 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.785379 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.785603 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.785742 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.785885 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.786021 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.786157 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.786291 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.786435 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.786572 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.786803 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.786947 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.787081 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.787237 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.787374 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.787508 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.787683 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.787835 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.787971 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.788114 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.788248 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.788388 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.788537 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.788676 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.788810 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.788953 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.789098 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.789232 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.789372 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.789506 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.789648 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.789793 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.789928 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.790068 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.790210 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.790345 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.790488 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.790623 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.791109 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.791268 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.791405 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.791539 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.791682 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.791818 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.791963 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.792108 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.792244 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.792377 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.792518 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.792659 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.792795 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.792939 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.793074 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.793207 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.793349 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.793483 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.793617 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.793750 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.793891 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.794035 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.794170 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.794304 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.794437 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.794570 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.794731 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.794888 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795024 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795158 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795291 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795425 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795567 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795710 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795845 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.795986 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.796121 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.796254 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.796387 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.796538 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.796680 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.796815 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.796947 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.797081 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.797264 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.797407 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.797569 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.797710 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.797883 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.798026 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.798204 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.798486 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.798804 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.798953 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.799725 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.799873 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.800174 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.800319 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.800453 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.800597 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.800745 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.800889 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.801038 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.801175 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.801333 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.801553 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.801707 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.801855 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.801990 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.802124 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.802267 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.802402 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.802536 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.802688 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.802886 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.803027 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.803194 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.803349 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.803508 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.803649 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.803816 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.803957 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.804124 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.804265 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.804427 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.804566 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.804729 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.804877 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.805034 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.805175 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.805319 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.805453 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.805629 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.806043 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.806184 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.806323 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.806498 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.806645 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.806826 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.806970 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.807128 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.807270 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.807437 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.807590 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.807735 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.807882 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.808016 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.808150 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.808324 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.808465 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.808631 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.808774 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.808936 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.809083 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.809265 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.809424 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.809653 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.809801 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.809938 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.810080 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.810215 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.810350 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.810533 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.810702 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.810881 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.811019 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.811153 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.811301 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.811457 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.811599 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.811735 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.811878 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.812020 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.812163 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.812332 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.812486 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.812628 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.812769 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.812934 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.813083 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.813218 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.813361 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.813533 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.813674 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.813842 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.813995 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.814137 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.814270 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.814439 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.814587 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.814898 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.815048 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.815186 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.815375 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.815560 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.815699 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.815842 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.815979 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.816113 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.816247 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.816387 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.816523 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.816665 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.816801 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.816936 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.817115 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.817275 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.817418 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.817601 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.817765 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.817901 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.818036 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.818169 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.818315 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.818464 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.818599 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.818772 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.818921 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.819056 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.819214 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.819350 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.819484 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.819618 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.819763 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.819908 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.820094 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.820235 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.820377 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.820512 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.820677 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.820850 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821002 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821157 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821299 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821451 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821587 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821720 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821862 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.821998 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.822133 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.822267 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.822433 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.822584 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.822834 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.822974 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.823124 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.823269 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.823411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.823556 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.823692 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.823831 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.823975 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.824110 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.824245 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.824388 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.824523 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.824658 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.824831 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.824973 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.825134 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.825293 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.825430 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.825564 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.825721 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.825863 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.826006 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.826146 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.826310 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.826461 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.826628 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.826805 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.826961 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.827099 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.827240 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.827376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.827542 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.827691 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.827841 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.827975 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.828174 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.828317 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.828477 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.828617 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.828837 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.828987 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.829128 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.829262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.829447 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.829596 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.829767 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.829913 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.830079 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.830218 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.830455 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.830733 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.830954 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.831121 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.831259 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.831400 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.831536 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.831679 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.831814 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.831947 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.832081 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.832221 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.832221 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.832492 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.832628 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.832762 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.832913 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.833055 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.833190 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.833333 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.833475 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.833610 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.833745 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.833886 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.834055 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.834198 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.834377 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.834526 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.834703 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.834846 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.834992 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.835135 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.835303 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.835480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.835619 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.835753 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.835896 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.836090 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.836271 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.836445 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.836627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.836815 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.837001 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.837257 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.837452 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.837636 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.837819 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.838104 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.838300 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.838486 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.838750 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.838955 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.839155 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.839365 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.839564 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.839757 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.839757 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.840126 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.840310 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.840514 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.840716 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.840918 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.841130 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.841331 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.841533 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.841764 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.841764 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.842091 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.842239 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.842381 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.842530 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.842696 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.842861 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.843012 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.843012 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.843281 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.843434 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.843575 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.843715 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.843865 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.844012 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.844154 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.844154 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.844430 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.844576 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.844716 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.844856 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.845002 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.845151 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.845301 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.845450 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.845592 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.845742 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.846399 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.846569 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.846910 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.847125 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.847298 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.847447 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.847602 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.847758 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.847901 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.848051 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.848200 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.848350 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.848541 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.848719 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.848864 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.849012 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.849160 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.849303 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.849453 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.849595 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.849742 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.849883 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.850084 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.850279 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.850470 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.850701 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.850944 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.851148 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.851349 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.851565 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.851767 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.851970 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.852179 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.852382 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.852587 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.852798 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.853010 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.853225 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.853411 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.853595 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.853779 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.853976 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.854178 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.854392 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.854595 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.854838 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.855054 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.855290 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.855447 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.855598 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.855753 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.855895 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.856035 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.856176 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.856326 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.856468 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.856608 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.856761 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.856902 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857043 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857193 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857345 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857498 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857646 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857789 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857889 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.857988 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858083 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858167 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858248 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858337 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858426 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858516 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858597 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858712 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858811 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858898 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.858988 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859064 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859144 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859222 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859318 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859405 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859495 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859576 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859654 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859732 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859810 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859897 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.859995 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860076 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860155 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860233 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860311 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860396 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860484 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860564 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860650 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860729 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860814 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.860922 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.861011 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.861096 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.861175 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.861253 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.861339 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.861433 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.861689 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.862428 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.862727 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.862956 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.863117 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.863272 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.863416 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.863601 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.863797 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.863983 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.864169 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.864363 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.864558 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.864741 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.864940 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.865151 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.865373 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.865578 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.865779 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.866003 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.866221 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.866412 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.866607 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.866818 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.867003 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.867204 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.867398 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.867600 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.867815 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.868018 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.868223 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.868426 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.868641 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.868877 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.869037 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.869181 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.869322 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.869471 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.869622 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.869776 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.869919 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.870060 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.870200 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.870340 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.870481 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.870641 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.870849 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.870992 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.871132 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.871279 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.871422 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.871576 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.871719 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.871859 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.872000 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.872139 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.872298 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.872458 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.872608 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.872750 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.872891 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.873030 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.873183 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.873325 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.873465 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.873618 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.873760 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.873900 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.874050 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.874198 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.874351 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.874492 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.874633 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.874796 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.874950 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.875094 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.875235 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.875375 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.875516 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.875666 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.875808 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.875948 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.876094 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.876254 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.876440 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.876638 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.876833 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.877018 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.877233 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.877426 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.877622 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.877837 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.878039 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.878238 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.878441 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.878652 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.878897 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.879181 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.879370 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.879578 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.879773 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.879966 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.880151 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.880350 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.880554 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.880755 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.880956 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.881158 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.881390 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.881602 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.881798 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.881942 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.882084 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.882235 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.882386 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.882529 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.882709 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.882870 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.883021 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.883163 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.883313 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.883466 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.883607 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.883747 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.883887 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.884041 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.884184 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.884324 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.884465 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.884606 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.884747 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.884897 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.885038 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.885190 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.885332 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.885473 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.885614 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.885763 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.885906 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.886048 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.886189 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.886330 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.886545 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.886716 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.886875 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.887029 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.887029 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.887301 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.887301 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.887581 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.887757 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.887902 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.888043 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.888192 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.888342 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.888484 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.888644 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.888792 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.888935 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.889084 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.889225 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.889366 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.889507 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.889657 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.889798 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.889947 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.890089 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.890229 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.890378 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.890529 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.890714 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.890874 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.891017 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.891158 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.891298 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.891439 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.891593 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.891736 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.891884 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.892027 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.892179 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.892331 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.892481 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.892622 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.892788 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.892936 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.893112 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.893335 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.893481 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.893630 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.893780 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.893920 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.894061 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.894209 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.894368 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.894511 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.894651 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.894841 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.894841 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.895128 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.895270 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.895411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.895552 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.895692 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.895841 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.895983 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.896123 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.896273 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.896414 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.896554 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.896707 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.896857 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.897005 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.897146 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.897287 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.897427 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.897576 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.897726 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.897867 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.898022 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.898162 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.898309 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.898458 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.898601 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.898816 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.898960 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.899100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.899252 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.899393 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.899533 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.899672 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.899813 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.899963 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.900122 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.900265 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.900406 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.900553 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.900694 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.900835 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.900993 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.901134 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.901275 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.901414 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.901555 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.901780 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.901946 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.902098 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.902240 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.902380 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.902521 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.902692 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.902841 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.902983 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.903123 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.903263 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.903402 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.903554 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.903718 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.903860 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.904002 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.904141 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.904281 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.904429 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.904582 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.904723 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.904864 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.905006 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.905147 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.905296 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.905436 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.905594 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.905736 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.905877 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.906027 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.906169 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.906309 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.906449 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.906590 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.906795 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.906952 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.907094 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.907235 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.907375 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.907525 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.907666 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.907814 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.907956 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.908104 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.908246 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.908895 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.909061 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.909264 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.909410 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.909550 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.909691 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.909831 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.909996 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.910139 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.910280 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.910423 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.910563 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.910721 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.910880 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.911023 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.911171 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.911314 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.911462 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.911603 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.911753 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.911905 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.912056 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.912198 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.912340 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.912487 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.912637 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.912787 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.912929 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.913069 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.913209 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.913357 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.913507 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.913659 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.913807 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.913957 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.914099 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.914253 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.914395 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.914536 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.914699 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.914863 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.915006 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.915160 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.915302 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.915443 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.915595 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.915743 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.915892 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.916042 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.916191 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.916332 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.916472 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.916620 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.916771 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.916919 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.917061 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.917201 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.917352 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.917493 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.917647 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.917795 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.917944 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.918086 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.918235 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.918377 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.918526 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.918708 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.918858 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.919000 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.919140 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.919303 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.919446 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.919587 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.919728 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.919869 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.920009 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.920158 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.920300 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.920447 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.920589 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.920738 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.920880 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.921104 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.921255 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.921396 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.921536 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.921677 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.921827 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.921982 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.922135 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.922288 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.922430 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.922570 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.922751 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.922904 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.923063 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.923204 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.923351 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.923500 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.923656 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.923798 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.923940 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.924684 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.924826 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.924932 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925015 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925093 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925169 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925312 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925456 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925644 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925788 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.925974 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.926108 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.926292 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.926433 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.926617 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.926773 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.926958 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.927107 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.927291 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.927450 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.927634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.927781 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.927969 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.928107 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.928298 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.928416 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.928605 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.928740 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.928913 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.929039 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.929221 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.929362 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.929535 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.929668 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.929856 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.929981 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.930166 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.930306 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.930471 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.930598 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.931065 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.931195 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.931371 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.931496 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.931677 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.931802 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.931980 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.932107 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.932284 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.932420 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.932590 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.932714 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.932888 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.933012 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.933190 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.933318 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.933492 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.933618 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.933793 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.933920 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.934096 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.934222 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.934399 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.934524 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.934729 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.934870 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.935041 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.935164 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.935345 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.935469 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.935649 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.935783 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.935957 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.936084 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.936260 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.936398 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.936563 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.936696 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.936897 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.937024 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.937215 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.937346 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.937533 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.937658 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.937845 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.937969 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.938158 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.938290 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.938466 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.938593 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.938803 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.938938 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.939123 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.939247 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.939441 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.939567 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.939782 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.939970 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.940133 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.940259 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.940510 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.940638 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.940825 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.940961 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.941141 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.941280 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.941455 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.941582 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.941767 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.941893 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.942078 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.942217 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.942392 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.942517 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.942747 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.942880 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.943057 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.943194 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.943378 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.943504 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.943696 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.943829 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.944014 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.944148 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.944327 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.944450 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.944641 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.944766 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.944953 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.945085 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.945275 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.945399 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.945586 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.945712 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.945895 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.946030 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.946203 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.946326 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.946513 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.946636 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.946852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.946979 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.947163 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.947287 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.947474 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.947607 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.947788 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.947912 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.948104 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.948230 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.948427 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.948560 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.948748 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.948878 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.949088 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.949293 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.949416 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.949671 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.949825 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.949959 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.950088 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.950215 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.950427 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.950564 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.950721 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.950850 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.950985 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.951111 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.951310 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.951438 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.951624 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.951756 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.951930 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.952057 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.952196 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:05:38.952330 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:05:38.952454 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:05:39.105075 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO dbcounter [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Registered counter for database nova_api Sep 06 16:05:39.105722 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO dbcounter [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Registered counter for database nova_api Sep 06 16:05:39.126581 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_db.sqlalchemy.engines [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.130009 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_db.sqlalchemy.engines [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.133597 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writer thread running {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.136633 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writer thread running {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.191816 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.context [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e869643c-c539-4de1-8cc0-80684df9a8fd(cell1) {{(pid=105724) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:05:39.195842 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_concurrency.lockutils [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:05:39.196336 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_concurrency.lockutils [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:05:39.196514 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.context [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e869643c-c539-4de1-8cc0-80684df9a8fd(cell1) {{(pid=105726) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:05:39.197923 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_concurrency.lockutils [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:05:39.198684 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_concurrency.lockutils [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:05:39.199143 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_concurrency.lockutils [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:05:39.200367 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:05:39.200840 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:05:39.201147 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_concurrency.lockutils [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:05:39.202404 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:05:39.203151 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:05:39.203247 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO dbcounter [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Registered counter for database nova_cell0 Sep 06 16:05:39.203590 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:05:39.206113 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:05:39.208175 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO dbcounter [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Registered counter for database nova_cell0 Sep 06 16:05:39.208308 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO dbcounter [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Registered counter for database nova_cell1 Sep 06 16:05:39.212362 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO dbcounter [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Registered counter for database nova_cell1 Sep 06 16:05:39.216185 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_db.sqlalchemy.engines [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.218176 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_db.sqlalchemy.engines [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.220646 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_db.sqlalchemy.engines [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.222595 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_db.sqlalchemy.engines [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.225717 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writer thread running {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.227282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writer thread running {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.229064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writer thread running {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.231331 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writer thread running {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.374955 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO dbcounter [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Registered counter for database nova_cell0 Sep 06 16:05:39.376632 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO dbcounter [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Registered counter for database nova_cell0 Sep 06 16:05:39.382144 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG oslo_db.sqlalchemy.engines [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.385487 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_db.sqlalchemy.engines [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:05:39.387107 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writer thread running {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.390218 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writer thread running {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:05:39.735108 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: WARNING keystonemiddleware.auth_token [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:05:39.735953 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: WARNING keystonemiddleware.auth_token [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:05:39.742507 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: WARNING keystonemiddleware.auth_token [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:05:39.743530 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: WARNING keystonemiddleware.auth_token [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:05:40.087247 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: WARNING keystonemiddleware.auth_token [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:05:40.089582 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: WARNING keystonemiddleware.auth_token [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:05:40.093239 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: WARNING keystonemiddleware.auth_token [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:05:40.095579 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: WARNING keystonemiddleware.auth_token [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:05:40.100137 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55737c8b59c0 pid: 105724 (default app) Sep 06 16:05:40.101550 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55737c8b59c0 pid: 105726 (default app) Sep 06 16:05:40.102348 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:05:40.103606 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-acd6402b-a1ba-4c9c-9fc4-87567d6adc92 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001900 Sep 06 16:05:40.104036 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Tue Sep 6 16:05:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:05.744683 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:05.746612 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002665 Sep 06 16:07:05.747049 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:05.765163 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writing DB stats nova_api:SELECT=3 {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:05.766645 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writing DB stats nova_cell1:SELECT=3 {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:05.768617 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writing DB stats nova_cell0:SELECT=3 {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:05.772214 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:06.879328 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-ac0b02e8-5ec3-4e1f-be75-dba02853d5c2 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:06.913478 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-ac0b02e8-5ec3-4e1f-be75-dba02853d5c2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.156824 Sep 06 16:07:06.914021 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Sep 6 16:07:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:07:09.910094 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:09.911173 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-7d341b93-e696-4979-9005-7a0a3616f170 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 06 16:07:09.911955 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:10.675093 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-07471daf-46ee-43f9-b7b4-b43d3ccc3372 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:10.734868 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-07471daf-46ee-43f9-b7b4-b43d3ccc3372 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.815755 Sep 06 16:07:10.736300 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:07:10.755389 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_api:SELECT=3 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:10.756396 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_cell0:SELECT=3 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:10.757600 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_cell1:SELECT=3 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:10.758508 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:10.996325 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-12f4a102-e599-4b05-8fbe-d0c14720c8ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:11.077841 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-12f4a102-e599-4b05-8fbe-d0c14720c8ac admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.329122 Sep 06 16:07:11.078848 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Sep 6 16:07:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:07:13.572675 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-07471daf-46ee-43f9-b7b4-b43d3ccc3372 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:13.573698 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-07471daf-46ee-43f9-b7b4-b43d3ccc3372 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 06 16:07:13.574095 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:14.437175 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-e8d87aa3-0511-4025-9b9c-54908a74958c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "id": "d1"}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:14.479513 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-e8d87aa3-0511-4025-9b9c-54908a74958c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.898467 Sep 06 16:07:14.480314 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:07:14.493052 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-d9116a74-bfcc-46f0-9283-3c4f481d42f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:14.540298 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-d9116a74-bfcc-46f0-9283-3c4f481d42f3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051112 Sep 06 16:07:14.546730 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Sep 6 16:07:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:07:17.151087 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-e8d87aa3-0511-4025-9b9c-54908a74958c admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:17.152270 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-e8d87aa3-0511-4025-9b9c-54908a74958c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Sep 06 16:07:17.152991 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:07:17.684133 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-582d8452-ef64-4b40-a3d1-0897ab2f78c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2", "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:17.713300 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-582d8452-ef64-4b40-a3d1-0897ab2f78c8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.549556 Sep 06 16:07:17.714556 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:07:17.727587 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-891123f4-3189-4c60-803c-8fda4a809b8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:17.758751 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-891123f4-3189-4c60-803c-8fda4a809b8e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034916 Sep 06 16:07:17.759598 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Sep 6 16:07:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:07:20.380438 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-582d8452-ef64-4b40-a3d1-0897ab2f78c8 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:20.381589 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-582d8452-ef64-4b40-a3d1-0897ab2f78c8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 06 16:07:20.382101 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:21.048528 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-28eaab8f-055c-4f29-bc0a-2713423542d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "ram": 2048, "id": "d3", "disk": 10, "rxtx_factor": 1.0}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:21.069312 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-28eaab8f-055c-4f29-bc0a-2713423542d7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.676447 Sep 06 16:07:21.070217 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:07:21.083453 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-b0088e47-95b2-4762-8d1f-cc4253a9d7ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:21.111175 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-b0088e47-95b2-4762-8d1f-cc4253a9d7ce admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031700 Sep 06 16:07:21.111937 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Sep 6 16:07:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:07:23.809753 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-28eaab8f-055c-4f29-bc0a-2713423542d7 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:23.810792 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-28eaab8f-055c-4f29-bc0a-2713423542d7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 06 16:07:23.811197 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:24.314814 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-aab293ca-e690-4007-be50-3053a7532b87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:24.342490 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-aab293ca-e690-4007-be50-3053a7532b87 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524673 Sep 06 16:07:24.346437 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:07:24.359028 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-30ba1a01-e4e6-4f62-b30d-0711f475e694 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:24.393019 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-30ba1a01-e4e6-4f62-b30d-0711f475e694 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038074 Sep 06 16:07:24.393595 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Sep 6 16:07:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:07:27.199419 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-aab293ca-e690-4007-be50-3053a7532b87 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:27.201006 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-aab293ca-e690-4007-be50-3053a7532b87 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002283 Sep 06 16:07:27.201639 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:27.720276 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-9266426c-dd1d-4733-81f8-fe9232e0d89c admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:27.745647 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-9266426c-dd1d-4733-81f8-fe9232e0d89c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.535553 Sep 06 16:07:27.746169 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Sep 6 16:07:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:07:30.572761 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-aab293ca-e690-4007-be50-3053a7532b87 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:30.574128 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-aab293ca-e690-4007-be50-3053a7532b87 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Sep 06 16:07:30.574801 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:07:31.162591 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-f3c65b56-1c7d-4f31-a40f-d011c1a5a411 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:31.186706 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-f3c65b56-1c7d-4f31-a40f-d011c1a5a411 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.605274 Sep 06 16:07:31.188102 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:07:31.201819 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-ccdde3df-3b18-42ad-b658-bfab32b2c4c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:31.229338 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-ccdde3df-3b18-42ad-b658-bfab32b2c4c3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031337 Sep 06 16:07:31.230690 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Sep 6 16:07:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:07:33.788651 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-f3c65b56-1c7d-4f31-a40f-d011c1a5a411 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:33.789693 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-f3c65b56-1c7d-4f31-a40f-d011c1a5a411 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 06 16:07:33.790128 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:34.296823 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-24fc9027-c91f-4b3f-9c78-2f227ebe3f88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:34.323232 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-24fc9027-c91f-4b3f-9c78-2f227ebe3f88 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.524853 Sep 06 16:07:34.326702 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:07:34.339874 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-e95c1b26-0946-4bdd-9203-2792ff3a9803 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:34.372866 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-e95c1b26-0946-4bdd-9203-2792ff3a9803 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038967 Sep 06 16:07:34.373560 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Sep 6 16:07:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:07:37.042223 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-24fc9027-c91f-4b3f-9c78-2f227ebe3f88 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:37.043305 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-24fc9027-c91f-4b3f-9c78-2f227ebe3f88 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 06 16:07:37.043951 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:07:37.723238 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-68aa5988-8499-435b-bdd7-82bc2701aebe admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:37.763570 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-68aa5988-8499-435b-bdd7-82bc2701aebe admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.711805 Sep 06 16:07:37.764342 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:07:37.780367 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-3e923c80-6f20-496c-a27d-c4078950f32d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:37.786620 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:37.816789 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-3e923c80-6f20-496c-a27d-c4078950f32d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042001 Sep 06 16:07:37.817377 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Sep 6 16:07:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:07:40.527453 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-68aa5988-8499-435b-bdd7-82bc2701aebe admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:40.530253 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-68aa5988-8499-435b-bdd7-82bc2701aebe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003757 Sep 06 16:07:40.531512 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:40 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:07:41.164124 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-aa4f8471-eeec-4941-bbb2-27f5ef6abb7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "disk": 80, "vcpus": 4, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:41.187731 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-aa4f8471-eeec-4941-bbb2-27f5ef6abb7b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.645240 Sep 06 16:07:41.195648 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:07:41.201387 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-636b1fb1-1ff5-492d-8dac-2c56c552b928 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:41.207660 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:07:41.234140 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-636b1fb1-1ff5-492d-8dac-2c56c552b928 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037215 Sep 06 16:07:41.234865 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Sep 6 16:07:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:07:43.895437 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-aa4f8471-eeec-4941-bbb2-27f5ef6abb7b admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:07:43.897235 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-aa4f8471-eeec-4941-bbb2-27f5ef6abb7b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002328 Sep 06 16:07:43.899218 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:07:43 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:07:44.465020 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-8deb1074-7a1b-4405-92ac-c15c66ed9273 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:44.487672 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-8deb1074-7a1b-4405-92ac-c15c66ed9273 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.583156 Sep 06 16:07:44.490720 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Sep 6 16:07:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:07:44.503500 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-f87dd657-df9b-45d1-92d7-1ff067b59528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:07:44.541062 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-f87dd657-df9b-45d1-92d7-1ff067b59528 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042072 Sep 06 16:07:44.548013 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Sep 6 16:07:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:08:01.933324 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-8deb1074-7a1b-4405-92ac-c15c66ed9273 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:01.934366 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-8deb1074-7a1b-4405-92ac-c15c66ed9273 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 06 16:08:01.934832 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:01.947629 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:02.356366 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-74f5cc59-360c-4aec-955d-feb65af7b9be admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:02.374511 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-74f5cc59-360c-4aec-955d-feb65af7b9be admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.431223 Sep 06 16:08:02.375133 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Sep 6 16:08:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:08:03.488673 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-8deb1074-7a1b-4405-92ac-c15c66ed9273 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:03.489661 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-8deb1074-7a1b-4405-92ac-c15c66ed9273 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Sep 06 16:08:03.490048 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:04.040746 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-a11fa2c2-711f-4ef4-9dbb-bd9dbe6493ac admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:04.047032 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.wsgi [None req-a11fa2c2-711f-4ef4-9dbb-bd9dbe6493ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-a11fa2c2-711f-4ef4-9dbb-bd9dbe6493ac admin admin] Request method failure captured: Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Accept: application/json Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Accept-Encoding: gzip, deflate Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Connection: keep-alive Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Content-Length: 0 Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Host: 10.222.0.26 Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Openstack-Api-Version: compute 2.92 Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Openstack-System-Scope: None Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: User-Agent: python-novaclient Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Auth-Token: gAAAAABjF3BjW5lbDhq17skQPMpZcTb_kzvDU5_pHeqluLKTjqPbBF0Du2Ok-EhhbirjoSgW-pPCcYXSp3SJLKT9Q8mEpGbcBBKctGfFUXy0CsuZUcg9W2B9umyjeYMyjLQ4lUqqT_5BLNJQ2iWz9BJMOdBI-QhbB4FMxHdeCvom2eHVtKvtHzo Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Domain-Id: None Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Domain-Name: None Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Identity-Status: Confirmed Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Is-Admin-Project: True Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Domain-Id: default Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Domain-Name: Default Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Name: admin Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Role: admin,member,reader Sep 06 16:08:04.050376 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Roles: admin,member,reader Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant: admin Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant-Name: admin Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User: admin Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Domain-Id: default Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Domain-Name: Default Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Id: feda116f177c415fa220633084d10d2f Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Name: admin Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: method: > Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: exception: Flavor 42 could not be found. Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: action_args: {'id': '42'} Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:08:04.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:04.053100 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-a11fa2c2-711f-4ef4-9dbb-bd9dbe6493ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:08:04.055337 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-a11fa2c2-711f-4ef4-9dbb-bd9dbe6493ac admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.424556 Sep 06 16:08:04.055337 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Sep 6 16:08:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:08:04.062695 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-c020ad0e-a695-406b-ab0a-feed11278bf8 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:04.066818 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:08:04.086113 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-c020ad0e-a695-406b-ab0a-feed11278bf8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027296 Sep 06 16:08:04.086650 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Sep 6 16:08:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:08:04.097053 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-45d8daa6-0fea-4518-b497-284117d1769c admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:04.120237 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-45d8daa6-0fea-4518-b497-284117d1769c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027335 Sep 06 16:08:04.120807 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Sep 6 16:08:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:08:04.130289 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-cdf8eeac-9bc4-48db-aeea-d9cdbf1ce63e admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:04.136309 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.wsgi [None req-cdf8eeac-9bc4-48db-aeea-d9cdbf1ce63e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-cdf8eeac-9bc4-48db-aeea-d9cdbf1ce63e admin admin] Request method failure captured: Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Accept: application/json Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Accept-Encoding: gzip, deflate Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Connection: keep-alive Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Content-Length: 0 Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Host: 10.222.0.26 Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Openstack-Api-Version: compute 2.92 Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Openstack-System-Scope: None Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: User-Agent: python-novaclient Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Auth-Token: gAAAAABjF3BjW5lbDhq17skQPMpZcTb_kzvDU5_pHeqluLKTjqPbBF0Du2Ok-EhhbirjoSgW-pPCcYXSp3SJLKT9Q8mEpGbcBBKctGfFUXy0CsuZUcg9W2B9umyjeYMyjLQ4lUqqT_5BLNJQ2iWz9BJMOdBI-QhbB4FMxHdeCvom2eHVtKvtHzo Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Domain-Id: None Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Domain-Name: None Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Identity-Status: Confirmed Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Is-Admin-Project: True Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Domain-Id: default Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Domain-Name: Default Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Name: admin Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Role: admin,member,reader Sep 06 16:08:04.139589 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Roles: admin,member,reader Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant: admin Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant-Name: admin Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User: admin Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Domain-Id: default Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Domain-Name: Default Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Id: feda116f177c415fa220633084d10d2f Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Name: admin Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: method: > Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: exception: Flavor 42 could not be found. Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: action_args: {'id': '42'} Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:08:04.141634 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:04.142562 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:04.143627 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-cdf8eeac-9bc4-48db-aeea-d9cdbf1ce63e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:08:04.144635 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-cdf8eeac-9bc4-48db-aeea-d9cdbf1ce63e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014277 Sep 06 16:08:04.144635 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Sep 6 16:08:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:08:05.134286 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-45d8daa6-0fea-4518-b497-284117d1769c admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:05.135329 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-45d8daa6-0fea-4518-b497-284117d1769c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 06 16:08:05.135732 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:05.695426 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-0977951d-ec9e-4d42-af12-396150f68467 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:05.701289 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.wsgi [None req-0977951d-ec9e-4d42-af12-396150f68467 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-0977951d-ec9e-4d42-af12-396150f68467 admin admin] Request method failure captured: Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Accept: application/json Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Accept-Encoding: gzip, deflate Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Connection: keep-alive Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Content-Length: 0 Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Host: 10.222.0.26 Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Openstack-Api-Version: compute 2.92 Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Openstack-System-Scope: None Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: User-Agent: python-novaclient Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Auth-Token: gAAAAABjF3Blvf6DaeV5uQ_SPmfScCzrFPOWz3T3k0ODjaYwEdqDysck7c0Nb4eJf6eCLcHXS_5WIBHDyFr-0lB8lVPs0HtBC3F0lULxzd72W2g7Q_eDWfv_L45nRcY1eejUHetbodY7PYbSXBnzEB2XdZT3HN7NHyCboOwIN6hglSzMFJRHkMo Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Domain-Id: None Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Domain-Name: None Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Identity-Status: Confirmed Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Is-Admin-Project: True Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Domain-Id: default Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Domain-Name: Default Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Name: admin Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Role: admin,member,reader Sep 06 16:08:05.703409 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Roles: admin,member,reader Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant: admin Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant-Name: admin Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User: admin Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Domain-Id: default Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Domain-Name: Default Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Id: feda116f177c415fa220633084d10d2f Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Name: admin Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: method: > Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: exception: Flavor 84 could not be found. Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: action_args: {'id': '84'} Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:08:05.704852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:05.706250 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.707411 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-0977951d-ec9e-4d42-af12-396150f68467 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:08:05.709417 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-0977951d-ec9e-4d42-af12-396150f68467 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.428253 Sep 06 16:08:05.709417 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Sep 6 16:08:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:08:05.715740 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-6e928f42-0f28-4b91-9c88-38042c332fe1 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:05.733466 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-6e928f42-0f28-4b91-9c88-38042c332fe1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021144 Sep 06 16:08:05.734035 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Sep 6 16:08:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:08:05.746050 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-d3056b89-4171-401d-95b1-4b094f50595f admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:05.761686 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-d3056b89-4171-401d-95b1-4b094f50595f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020397 Sep 06 16:08:05.762232 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Sep 6 16:08:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:08:05.772313 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-42b65c03-2079-433d-ac27-a5d1de8a5224 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:05.777798 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.wsgi [None req-42b65c03-2079-433d-ac27-a5d1de8a5224 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-42b65c03-2079-433d-ac27-a5d1de8a5224 admin admin] Request method failure captured: Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Accept: application/json Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Accept-Encoding: gzip, deflate Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Connection: keep-alive Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Content-Length: 0 Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Host: 10.222.0.26 Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Openstack-Api-Version: compute 2.92 Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Openstack-System-Scope: None Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: User-Agent: python-novaclient Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Auth-Token: gAAAAABjF3Blvf6DaeV5uQ_SPmfScCzrFPOWz3T3k0ODjaYwEdqDysck7c0Nb4eJf6eCLcHXS_5WIBHDyFr-0lB8lVPs0HtBC3F0lULxzd72W2g7Q_eDWfv_L45nRcY1eejUHetbodY7PYbSXBnzEB2XdZT3HN7NHyCboOwIN6hglSzMFJRHkMo Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Domain-Id: None Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Domain-Name: None Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Identity-Status: Confirmed Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Is-Admin-Project: True Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Domain-Id: default Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Domain-Name: Default Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Name: admin Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Role: admin,member,reader Sep 06 16:08:05.779431 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Roles: admin,member,reader Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant: admin Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant-Name: admin Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User: admin Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Domain-Id: default Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Domain-Name: Default Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Id: feda116f177c415fa220633084d10d2f Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Name: admin Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: method: > Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: exception: Flavor 84 could not be found. Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: action_args: {'id': '84'} Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:08:05.781020 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:05.781808 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:05.783138 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-42b65c03-2079-433d-ac27-a5d1de8a5224 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:08:05.784159 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-42b65c03-2079-433d-ac27-a5d1de8a5224 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012057 Sep 06 16:08:05.784159 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Sep 6 16:08:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:08:06.830233 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-d3056b89-4171-401d-95b1-4b094f50595f admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:06.831788 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-d3056b89-4171-401d-95b1-4b094f50595f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Sep 06 16:08:06.832351 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:07.384312 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-afe45db9-8d0d-488f-9908-2a52b2a33146 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:07.390288 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.wsgi [None req-afe45db9-8d0d-488f-9908-2a52b2a33146 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-afe45db9-8d0d-488f-9908-2a52b2a33146 admin admin] Request method failure captured: Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Accept: application/json Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Accept-Encoding: gzip, deflate Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Connection: keep-alive Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Content-Length: 0 Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Host: 10.222.0.26 Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Openstack-Api-Version: compute 2.92 Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Openstack-System-Scope: None Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: User-Agent: python-novaclient Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Auth-Token: gAAAAABjF3BmNWFDfDPXJYwhDbBzEHws3jhCb3v_cDFbo9oazTaQrXX9C4dvTLToaLlBHgAhxQDPfUe6gIhxHOJKljhAqKelcvMKLRgBTR6T5JRZYN4hJzNv3ZCuVrlxmcaOMhobw4el6PRNt8noE9HERGBdU_piEZn7nlLlFaYFWaInS-5J_gs Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Domain-Id: None Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Domain-Name: None Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Identity-Status: Confirmed Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Is-Admin-Project: True Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Domain-Id: default Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Domain-Name: Default Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Project-Name: admin Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Role: admin,member,reader Sep 06 16:08:07.391822 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Roles: admin,member,reader Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant: admin Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-Tenant-Name: admin Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User: admin Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Domain-Id: default Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Domain-Name: Default Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Id: feda116f177c415fa220633084d10d2f Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: X-User-Name: admin Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: method: > Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: exception: Flavor 451 could not be found. Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: action_args: {'id': '451'} Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:08:07.393361 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:07.394282 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.395695 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-afe45db9-8d0d-488f-9908-2a52b2a33146 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:08:07.396967 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-afe45db9-8d0d-488f-9908-2a52b2a33146 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.418152 Sep 06 16:08:07.396967 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Sep 6 16:08:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:08:07.402882 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-1ac8e7f6-0812-423c-8487-5263779d2141 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:07.418166 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-1ac8e7f6-0812-423c-8487-5263779d2141 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018777 Sep 06 16:08:07.418718 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Sep 6 16:08:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:08:07.429673 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:07.446246 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020113 Sep 06 16:08:07.446819 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Sep 6 16:08:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:08:07.457052 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-adaaa3fb-1c7d-45a0-b450-ef379af66aa7 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:07.462461 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.wsgi [None req-adaaa3fb-1c7d-45a0-b450-ef379af66aa7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-adaaa3fb-1c7d-45a0-b450-ef379af66aa7 admin admin] Request method failure captured: Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Accept: application/json Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Accept-Encoding: gzip, deflate Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Connection: keep-alive Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Content-Length: 0 Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Host: 10.222.0.26 Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Openstack-Api-Version: compute 2.92 Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Openstack-System-Scope: None Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: User-Agent: python-novaclient Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Auth-Token: gAAAAABjF3BmNWFDfDPXJYwhDbBzEHws3jhCb3v_cDFbo9oazTaQrXX9C4dvTLToaLlBHgAhxQDPfUe6gIhxHOJKljhAqKelcvMKLRgBTR6T5JRZYN4hJzNv3ZCuVrlxmcaOMhobw4el6PRNt8noE9HERGBdU_piEZn7nlLlFaYFWaInS-5J_gs Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Domain-Id: None Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Domain-Name: None Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Identity-Status: Confirmed Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Is-Admin-Project: True Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Domain-Id: default Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Domain-Name: Default Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Project-Name: admin Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Role: admin,member,reader Sep 06 16:08:07.464064 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Roles: admin,member,reader Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dcbe5a1252a54f0a914b3779a09b044d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant: admin Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant-Id: dcbe5a1252a54f0a914b3779a09b044d Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-Tenant-Name: admin Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User: admin Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Domain-Id: default Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Domain-Name: Default Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Id: feda116f177c415fa220633084d10d2f Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: X-User-Name: admin Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: method: > Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: exception: Flavor 451 could not be found. Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: action_args: {'id': '451'} Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:08:07.465616 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:07.466480 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: ERROR nova.api.openstack.wsgi Sep 06 16:08:07.467658 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-adaaa3fb-1c7d-45a0-b450-ef379af66aa7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:08:07.468726 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-adaaa3fb-1c7d-45a0-b450-ef379af66aa7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011919 Sep 06 16:08:07.468726 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Sep 6 16:08:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 16:08:08.453781 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:08.454925 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 06 16:08:08.455327 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:09.019451 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-6182d5e9-fb0c-4597-91b1-69238debc878 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:09.039299 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-6182d5e9-fb0c-4597-91b1-69238debc878 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.427742 Sep 06 16:08:09.039847 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Sep 6 16:08:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:08:10.028975 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:10.029978 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 06 16:08:10.031023 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:10.577546 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-cc8c8422-dfd0-410b-b50a-c0fca5b97974 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:10.596679 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-cc8c8422-dfd0-410b-b50a-c0fca5b97974 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.425733 Sep 06 16:08:10.597232 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Sep 6 16:08:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:08:11.587714 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:11.588723 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 06 16:08:11.589121 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:12.165374 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-196d8f24-c7e6-4cb9-979f-d40cb4f03c8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:12.185186 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-196d8f24-c7e6-4cb9-979f-d40cb4f03c8c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.445441 Sep 06 16:08:12.185747 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Sep 6 16:08:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:08:13.189997 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:13.191097 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 06 16:08:13.191423 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:13.732382 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-a8a0443b-5322-4fff-ac46-7bc16b1c3776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:08:13.752439 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-a8a0443b-5322-4fff-ac46-7bc16b1c3776 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.421355 Sep 06 16:08:13.752984 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Sep 6 16:08:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:08:14.731115 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:14.732143 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 06 16:08:14.732536 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:08:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:08:15.277217 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-8806aab8-3eb6-4874-a411-e7c39b7d0c04 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:08:15.298039 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-8806aab8-3eb6-4874-a411-e7c39b7d0c04 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.425941 Sep 06 16:08:15.298588 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Sep 6 16:08:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:09.977709 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:09.978775 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-17e7255d-80fa-41b8-9c3f-03ae30eac6c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 06 16:09:09.979190 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Tue Sep 6 16:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:09:09.989721 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:09:10.391413 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-bf3a4a86-ef5a-4fc3-8411-55e430cf5524 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:10.412244 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-bf3a4a86-ef5a-4fc3-8411-55e430cf5524 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.426942 Sep 06 16:09:10.412788 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Sep 6 16:09:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:09:10.436450 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG dbcounter [-] [105724] Writing DB stats nova_api:SELECT=14 {{(pid=105724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:09:10.440224 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-751f6108-d683-4485-8bbf-3108742f4b4b admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:10.448066 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-751f6108-d683-4485-8bbf-3108742f4b4b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014250 Sep 06 16:09:10.448593 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Sep 6 16:09:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:10.461073 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-c77dba20-aae9-456d-aa33-e50a1a944d50 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:10.470160 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-c77dba20-aae9-456d-aa33-e50a1a944d50 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012586 Sep 06 16:09:10.470812 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Sep 6 16:09:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:10.483176 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:10.491870 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012729 Sep 06 16:09:10.492339 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Sep 6 16:09:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:09:10.504751 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-9446c575-fca7-4ddf-b525-7ea13119db3b admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:09:10.512525 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-9446c575-fca7-4ddf-b525-7ea13119db3b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011379 Sep 06 16:09:10.513264 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Sep 6 16:09:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:12:11.161002 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:11.162040 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 06 16:12:11.162436 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:12:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:12:11.303563 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_api:SELECT=6 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:12:11.467700 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:11.471273 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:11.471742 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:11.472198 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:11.472903 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:11.473340 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:11.473758 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:11.507294 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-984b6a44-62ff-4e48-927b-5689fa5f9b0d admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.205302 Sep 06 16:12:11.507852 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Sep 6 16:12:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:12:12.342253 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:12.343448 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 06 16:12:12.343845 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:12:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:12:12.539773 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:12.543206 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:12.543685 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:12.544111 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:12.544823 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:12.545270 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:12.545686 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:12.566726 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-d9ab3075-5289-41fe-94e2-cedc06b8f7e7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.083625 Sep 06 16:12:12.567233 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Sep 6 16:12:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:12:23.813846 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:23.814904 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 06 16:12:23.815304 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:12:23.957049 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_cell0:SELECT=4 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:12:23.957698 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_cell1:SELECT=4 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:12:23.958332 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG dbcounter [-] [105726] Writing DB stats nova_api:SELECT=8 {{(pid=105726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:12:24.007458 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:24.010779 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:24.011242 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:24.011655 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:24.012350 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:24.012781 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:24.013185 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:24.039109 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-b4d63d77-2b88-45bc-913a-91a79737c092 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.086579 Sep 06 16:12:24.039654 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 37/74] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Sep 6 16:12:23 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:12:24.867119 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: DEBUG nova.api.openstack.wsgi [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] Calling method '>' {{(pid=105724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:24.868114 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: INFO nova.api.openstack.requestlog [None req-29c626de-7672-4a35-8683-e27368fa7849 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 06 16:12:24.868503 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: [pid: 105724|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Sep 6 16:12:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:12:25.060901 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG nova.api.openstack.wsgi [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] Calling method '>' {{(pid=105726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:12:25.064765 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:25.065241 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:25.065664 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:25.066408 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:12:25.066894 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:12:25.067313 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: DEBUG oslo_concurrency.lockutils [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:12:25.089271 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: INFO nova.api.openstack.requestlog [None req-c3e36cc0-1b2c-43e8-8fe3-32668dccbd87 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.081542 Sep 06 16:12:25.089848 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: [pid: 105726|app: 0|req: 38/76] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Sep 6 16:12:25 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:13:24.445789 dv-cinder-852208-18-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 16:13:24.446737 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: Tue Sep 6 16:13:24 2022 - graceful shutdown triggered... Sep 06 16:13:24.447390 dv-cinder-852208-18-iscsi devstack@n-api.service[105724]: Gracefully killing worker 1 (pid: 105724)... Sep 06 16:13:24.447940 dv-cinder-852208-18-iscsi devstack@n-api.service[105726]: Gracefully killing worker 2 (pid: 105726)... Sep 06 16:13:25.447088 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: worker 1 buried after 1 seconds Sep 06 16:13:25.447659 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: worker 2 buried after 1 seconds Sep 06 16:13:25.447659 dv-cinder-852208-18-iscsi devstack@n-api.service[105715]: goodbye to uWSGI. Sep 06 16:13:25.448837 dv-cinder-852208-18-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 16:13:25.449426 dv-cinder-852208-18-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 16:13:25.452576 dv-cinder-852208-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 16:13:25.462539 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 16:13:25 2022] *** Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: nodename: dv-cinder-852208-18-iscsi Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: machine: x86_64 Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: clock source: unix Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: pcre jit disabled Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: detected number of CPU cores: 4 Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: current working directory: / Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: detected binary path: /usr/bin/uwsgi-core Sep 06 16:13:25.464470 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: your processes number limit is 47680 Sep 06 16:13:25.465199 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: your memory page size is 4096 bytes Sep 06 16:13:25.465199 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: detected max file descriptor number: 2048 Sep 06 16:13:25.465199 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: lock engine: pthread robust mutexes Sep 06 16:13:25.465199 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: thunder lock: enabled Sep 06 16:13:25.465199 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 16:13:25.465199 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 16:13:25.505140 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: Python main interpreter initialized at 0x5637ffe0a9c0 Sep 06 16:13:25.505140 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: python threads support enabled Sep 06 16:13:25.505140 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: your server socket listen backlog is limited to 100 connections Sep 06 16:13:25.505140 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: your mercy for graceful operations on workers is 90 seconds Sep 06 16:13:25.505540 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 16:13:25.505616 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: *** Operational MODE: preforking *** Sep 06 16:13:25.505997 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: *** uWSGI is running in multiple interpreter mode *** Sep 06 16:13:25.505997 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: spawned uWSGI master process (pid: 120720) Sep 06 16:13:25.506091 dv-cinder-852208-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 16:13:25.506688 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: spawned uWSGI worker 1 (pid: 120738, cores: 1) Sep 06 16:13:25.507064 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: spawned uWSGI worker 2 (pid: 120739, cores: 1) Sep 06 16:13:25.507369 dv-cinder-852208-18-iscsi devstack@n-api.service[120720]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 16:13:26.181524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:13:26.182137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 16:13:27.350137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:13:27.350137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: from cryptography.utils import int_from_bytes Sep 06 16:13:27.350890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:13:27.350890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: from cryptography.utils import int_from_bytes Sep 06 16:13:27.356121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:13:27.356121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: from cryptography.utils import int_from_bytes Sep 06 16:13:27.356588 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 16:13:27.356588 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: from cryptography.utils import int_from_bytes Sep 06 16:13:29.814432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:13:29.815125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:13:29.815277 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:13:29.815678 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:13:29.815940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:13:29.816336 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.816671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.817000 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.817321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.817657 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.817974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.818302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.818631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.818989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.819253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.819571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.820060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-18-iscsi {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.820392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.820706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.821033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.821351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.821664 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.821992 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.822306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.822850 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.823604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.823924 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.824244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.824604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.824925 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.825236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.825554 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.825858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.826190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.826509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.826953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-18-iscsi {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.827287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.827617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.827934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.828358 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.828681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.828999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.829318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.829651 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.829971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.830294 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.830626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.830982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.831845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.832149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.832463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.832683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 16:13:29.833170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.833170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.833343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 16:13:29.833424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.833691 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.833950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.834062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 16:13:29.834264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.834595 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.834715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 16:13:29.834956 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.835118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 16:13:29.835282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.835537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.835759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.835860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.836107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.836331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.836454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.836732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.836902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.837063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.837351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.837468 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.837661 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.837973 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.838076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.838282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.838546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.838676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.838926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.839087 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.839260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.839582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.839693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.839960 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.840154 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.840311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.840411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.840606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.840715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.841012 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.841206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-18-iscsi {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.841312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.841536 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.841636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.841841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.841941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.842156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.842256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.842480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.842596 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.842853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.843024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.843176 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.843460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.843979 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.844181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.844356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.844510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.844682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.844835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.844979 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.845167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.845315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.845468 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.845623 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.845765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.845937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.846082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.846268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.846422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.846564 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.846751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.848828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.849021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.849021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.849302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.849302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.849530 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-18-iscsi {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.849715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.849863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.850145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.850279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.850393 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.850533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.850718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.850718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.850961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.851100 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.851250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.851387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.851517 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.851648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.851648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.851648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.852041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.852200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.852340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.853457 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.854264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.854446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.854596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.854789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.854944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855098 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.855717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.856412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.856572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.856723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.856873 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.857011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.857165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.857316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.857466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.857466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.857746 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.857886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.858033 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.858190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.858350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.858504 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.858641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.858904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.859052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.859190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.859347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.859497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.859635 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.859781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.859781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860366 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.860876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.861011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.861169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.861320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.861479 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.861653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.861813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.861981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.862182 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.862332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.862456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.862687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.863217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.863217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.863819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.864005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.864218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.864399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.864580 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.864704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.864884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.864884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.865225 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.865225 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.865597 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.865597 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.865883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.866023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.866167 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.866325 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.866465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.866621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.866778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.866933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.867028 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.867212 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.867318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.867462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.867600 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.867752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.867899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.868057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.868212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.868360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.868506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.868645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.868799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.868964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.869117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.869258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.869403 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.869541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.869677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.869825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.869988 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.870131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.870271 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.870417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.870558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.870757 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.870912 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.871148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.871518 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.871834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.871937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.872233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.872571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.873559 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.873703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.873784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.873856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.873937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.874010 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.874334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.874421 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.874421 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.874568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.874692 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.874790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.874945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.875029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.875268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.875355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.875597 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.875679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.876049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.876387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.876713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.877038 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.877361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.878058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.878058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.878374 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.879018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.879018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.879348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.879671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.879997 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.880319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.880639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.880954 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.881255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.881634 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.881959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.882251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.882474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.882829 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.882988 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.883327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.883448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.883537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.883809 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.884024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.884139 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.884427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.884606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.884742 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.885058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.885199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.885368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.885686 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.885785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.886002 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.886289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.886402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.886811 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.886932 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.887031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.887266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.887590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.887684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.887902 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.888151 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.888251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.888905 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.889033 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.889131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.889217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.889301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.889451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.889729 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.889836 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.890087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.890305 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.890398 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.890733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.890891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.891079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.891354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.891447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.891712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.891932 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.892143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.892365 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.892465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.892685 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.892982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.893086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.894455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.894579 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.894714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.894816 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.895042 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.895042 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.895229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.895316 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.895516 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.895723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.895814 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.896129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.896351 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.896456 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.896738 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.896854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.897075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.897404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.897519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.897688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.897861 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.897999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.898309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.898414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.898689 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.898902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.899014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.899341 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.899433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.899687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.899920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.900012 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.900331 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.900451 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.900652 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.900967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.901072 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.901279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.901562 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.901676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.901904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.902032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.902221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.902530 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.902640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.902897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.903104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.903226 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.903543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.903642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 16:13:29.903874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.904163 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.904268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.904608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.904713 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.904801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.905121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.905313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.905468 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.906128 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.906244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.906244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.906436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.906536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.906770 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.907029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.907149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.907406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.907535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.907743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.907965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.908175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.908377 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.908490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.908691 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.909037 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.909253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.909981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.910326 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.910541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.910682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.911094 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.911208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.911333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.911631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.911746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.911943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.912177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.912409 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.912604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.912745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.912923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.913241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.913335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.913568 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.913817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.913918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.914190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.914359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.914764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.914876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.914962 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.915250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.915452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.915666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.915821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.916075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.916231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.916388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.916697 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.916803 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.917017 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.917403 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.917514 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.917637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.917884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.917992 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.918222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.918552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.918910 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.919241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.919353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.919565 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.919843 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.919937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.920171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.920408 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.920550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.920799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.920990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.921107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.921420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.921575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.921744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.922065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.922165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.923940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.924215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.924307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.924555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.924938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.925109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.925466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.925561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.925841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.925942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.926029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.926142 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.926413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.926520 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.926766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.927582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.927724 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.927865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.927971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.928060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.928152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.928152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.928307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.928603 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.928713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.928923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.929072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.929510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.929610 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.930251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.930251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.930455 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.930549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.930804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.930969 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.931161 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.931600 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.931713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.931812 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.931941 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.932123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.932422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.932529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.932732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.933006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.933109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.933337 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.933584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.933684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.933948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.934160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.934264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.934552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.934760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.935115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.935240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.935337 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.935765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.936055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.936161 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.936475 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.936621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.936724 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.936988 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.937189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.937306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.937714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.937832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.937943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.938260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.938350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.938569 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.938868 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.938993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.939206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.939489 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.939590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.939855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.940070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.940200 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.940628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.940759 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.941123 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.941231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.941481 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.941699 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.941794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.942057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.942262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.942364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.942729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.942910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.943014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.943323 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.943431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.943637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.943919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.944018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.944249 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.944505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.944606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.944884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.945235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.945354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.945477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.945640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.945791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.946101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.946192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.946421 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.946711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.946819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.947060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.947283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.947385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.947673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.947926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.948021 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.948283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.948421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.948598 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.948926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.949031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.949229 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.949483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.949578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.949835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.950051 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.950150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.950445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.950644 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.950800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.951107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.951259 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.951436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.951741 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.951860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.952046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.952353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.952459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.952664 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.953024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.953141 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.953265 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.953515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.953608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.953891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.954099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.954203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.954503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.954730 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.954842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.955347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.955463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.955559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.955744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.955952 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.956662 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.956986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.957120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.957285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.957563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.957703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.958024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.958147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.958306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.958612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.958732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.959077 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.959189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.959367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.959678 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.959780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.959986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.960253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.960382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.960643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.960822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.961039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.961327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.961419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.961741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.961857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.961978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.962300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.962447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.962616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.962962 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.963070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.963275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.963531 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.963633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.963897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.964113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.964217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.964511 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.964679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.964819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.965147 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.965268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.965626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.965734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.965864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.966087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.966355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.966510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.966757 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.966990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.967109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.967373 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.967580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.967675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.968193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.968310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.968440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.968605 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.968832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.968933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.969228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.969425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.969526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.969843 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.969992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.970160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.970947 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.971075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.971165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.971269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.971373 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.971462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.971597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.971739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.972831 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.973032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.973167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.973431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.973612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.973792 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.973997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.974099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.974408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.974568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.974888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.975127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.975236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.975718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.975827 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.975915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.976131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.976230 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.976450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.976731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.976834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.977085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.977311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.977427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.977812 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.977918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.978129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.978434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.978535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.978785 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.979040 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.979143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.979395 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.979627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.979728 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.980027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.980205 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.980338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.980648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.980794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.980959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.981288 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.981401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.981601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.981862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.981957 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.982346 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.982520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.982733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.982966 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.983128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.983399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.983646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.983766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.983984 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.984080 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.984336 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.984563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.984665 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.984984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.985131 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.985296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.986250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.986375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.986474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.986649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.986839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.986943 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.987031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.987031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.987208 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.987315 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.988155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.988563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.988674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.988918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.989143 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.989238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.989559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.989740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.989994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.990239 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.990349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.990638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.990853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.991000 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.991335 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.991426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.992069 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.992206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.992305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.992393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.992479 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.992479 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.992859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.993004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.993189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.993496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.993729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.993839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.994065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.994159 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.994417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.994641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.994786 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.995051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.995251 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.995382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.995694 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.995787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.996024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.996432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.996544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.996662 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.996839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.996987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.997298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.997404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.997630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.997893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.997985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.998245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.998453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.998570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.998863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.999059 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.999220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.999532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.999681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:29.999859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.000146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.000240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.000524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.003296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.003450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.003535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.003624 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.003777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.003869 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.003965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004770 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004770 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.004925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.005834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.006078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.006181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.006546 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.006707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.006812 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.007118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.007211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.007431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.007724 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.007818 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.008046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.008335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.008441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.008703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.008973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.009088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.009345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.009437 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.009675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.009918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.010026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.010322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.010581 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.010712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.010966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.011103 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.011292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.011615 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.011706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.011939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.012255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.012365 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.012578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.012857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.012951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.013211 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.013472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.013797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.014021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.014123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.014440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.014639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.014803 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.016945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017067 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017880 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.017985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.018073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.018073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.018235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.018321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.018321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.018321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.018587 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.019559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.019664 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.019753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.020081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.020272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.020503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.020800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.020907 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.021127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.021388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.021490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.021758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.022004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.022096 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.022388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.022585 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.022744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.023127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.023281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.023523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.023720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.023821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.024068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.024304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.024413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.024698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.024878 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.025030 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.025372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.025473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.025700 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.025954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.026048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.026328 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.026516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.026650 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.027113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.027222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.027527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.027628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.027866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.028201 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.028400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.028532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.028854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.028945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.029183 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.029484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.029608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.029819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.030001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.030128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.030445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.030552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.031027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.031137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.031224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.031422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.031605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.031737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.032046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.032170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.032370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.032668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.032807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.033164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.033256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.033632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.033745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.033877 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.034208 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.034356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.034808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.034905 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.035195 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.035375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.035510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.035846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.035946 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.036164 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.036421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.036522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.036787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.037241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.037350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.037447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.037591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.037686 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.038003 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.038191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.038318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.038628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.038804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.038974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.039285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.039386 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.039628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.039921 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.040029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.040215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.040441 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.040535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.040830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.041025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.041142 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.041436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.041601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.041746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.042056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.042162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.042372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.042634 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.042762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.043108 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.043213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.043420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.043739 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.043854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.044084 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.044257 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.044400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.044710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.044808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.045041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.045301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.045402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.045738 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.045844 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.045970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.046287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.046387 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.046617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.046925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.047021 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.047396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.047503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.047599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.048178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.048301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.048534 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.048639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.048983 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.049083 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.049314 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.049712 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.049821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.050113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.050337 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.050457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.050653 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.050988 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.051322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.051432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.051645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.051943 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.052122 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.052378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.052493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.052582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.052884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.053080 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.053202 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.053518 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.053641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.053849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.054147 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.054262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.054463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.054790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.054899 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.055181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.055282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.055517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.055858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.055964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.056117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.056357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.056462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.056781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.056926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.057106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.057523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.057636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.057734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.057997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.058099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.058350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.058576 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.058729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.058998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.059165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.059322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.059653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.059771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.059974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.060244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.060351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.060959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.061057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.061279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.061525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.061620 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.061917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.062093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.062229 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.062558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.062705 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.062915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.063213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.063318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.063547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.063782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.063900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.064213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.064347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.064531 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.064841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.064952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.065188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.065418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.066041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.066433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.066540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.066784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.067752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.067858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.067858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.068037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.068124 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.068216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.068302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.068302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.068617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.069190 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.069314 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.069411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.069498 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.069631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.069942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.070060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.070259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.070541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.070671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.070909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.071152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.071253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.071517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.071718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.071826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.072127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.072286 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.072440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.072749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.072879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.073062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.073370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.073462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.073680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.073941 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.074032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.074323 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.074576 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.074732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.075002 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.075102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.075333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.075609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.075710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.075971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.076202 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.076309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.076612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.076778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.076941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.077270 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.077362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.077863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.077987 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.078086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.078226 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.078377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.078546 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.078899 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.079015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.079221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.079479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.079581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.079847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.080054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.080185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.080526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.080779 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.080903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.081190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.081522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.081632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.081962 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.082286 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.082392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.082636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.082797 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.082970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.083120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.083292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.083454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.083611 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.083789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.083928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.084124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.084245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.084438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.084550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.084755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.084858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.085073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.085170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.085388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.085496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.085704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.085800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.086093 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.086186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.086427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.086533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.086786 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.086986 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.087155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.087313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.087466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.087628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.088110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.088281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.088281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.088610 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.088762 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.088985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.089139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.089290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.089448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.089600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.089758 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.089919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.090073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.090231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.090393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.090551 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.090743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.090911 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120738) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:13:30.091072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.091072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.091072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.091527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.091787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.092089 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.092395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.092708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.093020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.093435 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.093752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.094064 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.094486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.094819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.095136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.095447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.095751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.096053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.096364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.096690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.097733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.098162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.098474 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.098826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.099143 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.099469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.099893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.100209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.100514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.100933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.101249 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.101561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.101886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.102209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.102536 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.102867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.103181 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.103543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.103820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.104145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.104459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.104778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.105083 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.105410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.105740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.106053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.106377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.106879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.107179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.107488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.107810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.108135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.108442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.108747 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.109062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.109369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.109674 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.109999 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.110306 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.110618 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.111074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.111386 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.111693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.112501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.112501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.113495 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.113656 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.113918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.114244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.114569 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.114903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.115229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.115541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.115845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.116153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.116440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.116782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.117090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.117411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.117743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.118076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.118435 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.118877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.119052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.119357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.119668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.119983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.120775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.120775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.121098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.121261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.121482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.121787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.122088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.122493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.122770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.123021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.123327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.123648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.123957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.124278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.124589 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.124896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.125204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.125506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.125852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.126160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.126492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.126825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.127152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.127470 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.127787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.128214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.128703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.129085 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.129528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.130004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.130437 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.130907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.131372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.131701 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.132281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.132650 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.132930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.133249 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.133699 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.134121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.134477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.134822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.135216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.135555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.136085 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.136689 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.137245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.137677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.138110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.138444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.138785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.139109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.139427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.139792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.140113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.140424 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.140784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.141197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.141517 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.141832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.142145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.142462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.142872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.143141 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.143481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.143875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.144259 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.144514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.144850 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.145173 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.145491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.145807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.146121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.146704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.147025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.147363 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.147690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.148016 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.148334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.148654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.148983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.149300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.149609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.149969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.150215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.150518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.150869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.151183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.151490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.151814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.152120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.152656 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.153003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.153315 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.153643 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.153969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.154287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.154593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.155001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.155165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Registered counter for database nova_api Sep 06 16:13:30.155340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.155531 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.155847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.156159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.156465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.156768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.157078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.157388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.157691 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.157999 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.158300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.158627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.159006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.159871 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.160367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.160830 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.161142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.161484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.161762 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.162068 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.162382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.162710 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.163148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.163426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.163747 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.164093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.164406 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.164718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.165101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.168157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.169685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.169685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.169685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.169685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.169685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.170560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.170560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.170560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.171122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.171408 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.171922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.172155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.172451 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.172765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.174870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.174870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.174870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.174870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.174870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.177234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.177717 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.178943 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.181303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.181637 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.181984 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.182337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.182748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.183108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.183587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.183786 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.184123 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.184469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.184909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.185189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.185770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.186106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.186453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.186812 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.187137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.187611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.187941 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.188329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.188662 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.188767 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.188990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.189334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.189698 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.190019 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.190354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.190695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.191042 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.191400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.191848 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.192193 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.192513 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.192832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.193148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.193472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.193805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.194126 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.194442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.194787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.195108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.195423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.195739 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.196055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.196369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.196686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.196998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.197312 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.197643 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.197938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.198248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.198561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.198919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.199232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.199549 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.199860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.200176 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.200485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.200828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.201174 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.201500 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.201834 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.202156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.202488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.202835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.203194 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.203535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.203859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.204176 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.204516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.204836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.205157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.205477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.205796 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.206115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.206679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.207087 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.207356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.207671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.208009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.208338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.208668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.208994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.209318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.209665 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.209976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.210302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.210628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.210962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.211282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.211605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.211922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.212243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.212567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.212889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.213226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.213564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.213879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.214212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.214546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.214929 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.215252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.215605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.215943 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.216266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.216588 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.216903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 16:13:30.217165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 16:13:30.246923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.context [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e869643c-c539-4de1-8cc0-80684df9a8fd(cell1) {{(pid=120738) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:13:30.251007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:30.251477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:30.253116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:30.253894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:30.254350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:30.256396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:30.258389 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Registered counter for database nova_cell0 Sep 06 16:13:30.262478 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Registered counter for database nova_cell1 Sep 06 16:13:30.270775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.271626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.278607 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.279982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Registered counter for database nova_api Sep 06 16:13:30.280117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.301969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.308770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.367894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.context [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e869643c-c539-4de1-8cc0-80684df9a8fd(cell1) {{(pid=120739) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 16:13:30.371905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:30.372381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:30.374061 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:30.374849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:13:30.375301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:13:30.377289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:13:30.379906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Registered counter for database nova_cell0 Sep 06 16:13:30.384115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Registered counter for database nova_cell1 Sep 06 16:13:30.391357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.393652 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.399845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.401436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.432572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO dbcounter [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Registered counter for database nova_cell0 Sep 06 16:13:30.442933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_db.sqlalchemy.engines [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120738) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.447752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writer thread running {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.579280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Registered counter for database nova_cell0 Sep 06 16:13:30.587831 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 16:13:30.592235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 16:13:30.773232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:13:30.780464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:13:30.930035 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:13:30.937692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:13:31.129345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:13:31.135796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: WARNING keystonemiddleware.auth_token [None req-5c0bdcc1-de2d-4b85-8080-021a6c67d187 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:13:31.141384 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637ffe0a9c0 pid: 120738 (default app) Sep 06 16:13:31.298648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 16:13:31.305747 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-d2b20399-393a-486a-a261-ab365b72fd09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 16:13:31.313412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637ffe0a9c0 pid: 120739 (default app) Sep 06 16:14:08.010284 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:08.011674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:08.012731 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:08.014181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:09.105369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:09.107544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:09.108603 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:09.109480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:09.188264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-73dd7a7b-cb71-4a66-8415-7a36737be65d tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Action: 'create', calling method: .version_select at 0x7f21b8ff9310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-294108242", "metadata": {"Type": "work"}}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:10.532331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e10651c5-0b61-4ab9-b1e6-1fc378546dc6 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Action: 'create', calling method: .version_select at 0x7f21b8ff9310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-555157045"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:12.035314 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-73dd7a7b-cb71-4a66-8415-7a36737be65d tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.045744 Sep 06 16:14:12.037216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Sep 6 16:14:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4050 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 16:14:12.073639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5d0aa91a-8918-4ded-97fc-cfcb5925adca tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Calling method '.version_select at 0x7f21b8ed91f0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:12.332487 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e10651c5-0b61-4ab9-b1e6-1fc378546dc6 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.240942 Sep 06 16:14:12.333371 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Sep 6 16:14:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3244 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 16:14:12.351552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-deff427b-fd77-44a1-af6c-5b7642dc5612 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8ed91f0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:12.681529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5d0aa91a-8918-4ded-97fc-cfcb5925adca tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b" status: 200 len: 352 microversion: 2.1 time: 0.632727 Sep 06 16:14:12.682716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:12 2022] GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b => generated 352 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:12.699548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b3db287f-e317-4f65-8b51-a780dbf96820 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b8ed98b0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:12.889395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-deff427b-fd77-44a1-af6c-5b7642dc5612 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 200 len: 344 microversion: 2.1 time: 0.542397 Sep 06 16:14:12.890514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:12 2022] GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 344 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:14:13.224739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b3db287f-e317-4f65-8b51-a780dbf96820 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f6d1e301-20dc-4b63-8cbe-d26a3a942c07" status: 200 len: 351 microversion: 2.1 time: 0.539854 Sep 06 16:14:13.228300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:12 2022] GET /compute/v2.1/os-volumes/f6d1e301-20dc-4b63-8cbe-d26a3a942c07 => generated 351 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:13.719600 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5d8e1bd-427c-44bf-b58f-c54fd09a445b tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Calling method '.version_select at 0x7f21b8ed98b0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:13.808233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5d8e1bd-427c-44bf-b58f-c54fd09a445b tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b" status: 200 len: 353 microversion: 2.1 time: 0.114349 Sep 06 16:14:13.809414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:13 2022] GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:13.825559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-42fcb237-c29b-4d97-b7d2-1834a15e7efc tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Calling method '.version_select at 0x7f21b8e62040>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:13.905506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cf72ba46-9732-4c8b-828b-8ca2037c4a27 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e61040>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:13.954718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-42fcb237-c29b-4d97-b7d2-1834a15e7efc tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b" status: 200 len: 353 microversion: 2.1 time: 0.134820 Sep 06 16:14:13.956214 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:13 2022] GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:13.976604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-742c03f3-b075-44af-985c-1cc532f3c63c tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Calling method '.version_select at 0x7f21b8ed9dc0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:14.028473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cf72ba46-9732-4c8b-828b-8ca2037c4a27 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 200 len: 345 microversion: 2.1 time: 0.126866 Sep 06 16:14:14.029194 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:13 2022] GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:14:14.044268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bfe068e6-f12c-44da-870d-764a0452e642 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Action: 'create', calling method: .version_select at 0x7f21b8ed9d30>, body: {"snapshot": {"volume_id": "b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1291577924"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:14.107677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-742c03f3-b075-44af-985c-1cc532f3c63c tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b" status: 202 len: 0 microversion: 2.1 time: 0.136163 Sep 06 16:14:14.108687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:14:13 2022] DELETE /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:14:14.120020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-78849ac5-ae1f-4965-b65b-dd0b6b109c66 tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Calling method '.version_select at 0x7f21b8ed9670>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:14.274198 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-78849ac5-ae1f-4965-b65b-dd0b6b109c66 tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b" status: 200 len: 352 microversion: 2.1 time: 0.160001 Sep 06 16:14:14.275219 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 6/10] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:14 2022] GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b => generated 352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:14.620672 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bfe068e6-f12c-44da-870d-764a0452e642 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.581119 Sep 06 16:14:14.621254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 5/11] 10.222.0.26 () {60 vars in 1162 bytes} [Tue Sep 6 16:14:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:14:14.640300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8c269b7e-97e2-4bf6-9adf-1213a453c068 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e623a0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:14.717840 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8c269b7e-97e2-4bf6-9adf-1213a453c068 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.087964 Sep 06 16:14:14.732805 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:14 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:14.740360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-38265a83-71d1-46f4-9d29-349d2eacadfc tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e61430>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:14.836115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-38265a83-71d1-46f4-9d29-349d2eacadfc tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.107748 Sep 06 16:14:14.846050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 6/13] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Sep 6 16:14:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:14.850468 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f2518f46-eae1-4b56-a395-5b95aaa0a1c2 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8ed93a0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:15.020442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-630e3852-bf6e-4d63-919b-0678b7b31b94 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b8ed91f0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:15.190599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f2518f46-eae1-4b56-a395-5b95aaa0a1c2 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.343736 Sep 06 16:14:15.192705 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 8/14] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:14 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:15.288289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-630e3852-bf6e-4d63-919b-0678b7b31b94 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8ec5661c-642f-4ea2-9e8f-bd973b19b0ed" status: 200 len: 350 microversion: 2.1 time: 0.277269 Sep 06 16:14:15.297166 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7e6bb83c-fd9d-4e3b-b3a3-af34090a11ea tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Calling method '.version_select at 0x7f21b8ed9a60>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:15.298197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 7/15] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:15 2022] GET /compute/v2.1/os-volumes/8ec5661c-642f-4ea2-9e8f-bd973b19b0ed => generated 350 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:15.518737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-7e6bb83c-fd9d-4e3b-b3a3-af34090a11ea tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] HTTP exception thrown: Volume 1d095777-990d-4ca8-8deb-0759e8444a2b could not be found. Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7e6bb83c-fd9d-4e3b-b3a3-af34090a11ea tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Request method failure captured: Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b HTTP/1.1 Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HPjCI9TtS7ca4EYNXu0Pcl3vCm1rNhn1m8ZmMLxORHPTJCqF_pIkB0FtdtDMSEoIeQVlRu21z0Qudq-JjGmc6y6spt4Hrzu0jjHJxnyfL8AjfO7FQyL6Ar3ljV6b1U88trkjENjHdont5P76ql7G0YtzccCwmSnsFPDlxWNSiV5uY Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 347b53ac5908475abfedad60e71e9aff Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesGetTestJSON-526330610 Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:14:15.524487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/347b53ac5908475abfedad60e71e9aff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_347b53ac5908475abfedad60e71e9aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/347b53ac5908475abfedad60e71e9aff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/347b53ac5908475abfedad60e71e9aff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesGetTestJSON-526330610 Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 347b53ac5908475abfedad60e71e9aff Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesGetTestJSON-526330610 Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesGetTestJSON-526330610-project Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 6dba48c67531490685d7dd342a2661ce Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesGetTestJSON-526330610-project Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Volume 1d095777-990d-4ca8-8deb-0759e8444a2b could not be found. Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '1d095777-990d-4ca8-8deb-0759e8444a2b'} Sep 06 16:14:15.528460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1d095777-990d-4ca8-8deb-0759e8444a2b could not be found. (HTTP 404) (Request-ID: req-154eeff9-fe96-4fc2-b17d-099011cb766a) Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:15.530522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:15.534710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1d095777-990d-4ca8-8deb-0759e8444a2b could not be found. Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:14:15.540176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1d095777-990d-4ca8-8deb-0759e8444a2b could not be found. Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1d095777-990d-4ca8-8deb-0759e8444a2b could not be found. Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7e6bb83c-fd9d-4e3b-b3a3-af34090a11ea tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] Returning 404 to user: Volume 1d095777-990d-4ca8-8deb-0759e8444a2b could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7e6bb83c-fd9d-4e3b-b3a3-af34090a11ea tempest-VolumesGetTestJSON-526330610 tempest-VolumesGetTestJSON-526330610-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b" status: 404 len: 109 microversion: 2.1 time: 0.243411 Sep 06 16:14:15.544780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:15 2022] GET /compute/v2.1/os-volumes/1d095777-990d-4ca8-8deb-0759e8444a2b => generated 109 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:14:16.211024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2e637b3f-9f43-43dc-9f60-854b7b74d950 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8ed9af0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:16.372565 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2e637b3f-9f43-43dc-9f60-854b7b74d950 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.169972 Sep 06 16:14:16.374490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:16 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:17.396906 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-265767ee-80a9-4bae-9ee2-c71c1fa8f6bb tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e62a60>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:17.629963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-265767ee-80a9-4bae-9ee2-c71c1fa8f6bb tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.241337 Sep 06 16:14:17.639092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 10/18] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:17 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:18.647835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5d7ec250-8c0b-4da8-b976-751f5b2797bb tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e61ee0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:18.799286 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5d7ec250-8c0b-4da8-b976-751f5b2797bb tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.156008 Sep 06 16:14:18.800413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 9/19] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:18 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:19.821994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-60d76f20-9f55-47a7-8eb6-32379623c19a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e49160>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:20.013982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-60d76f20-9f55-47a7-8eb6-32379623c19a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.199706 Sep 06 16:14:20.016843 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:19 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:21.034310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8f6054ac-6391-41a3-a478-a564eed3d084 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8ed99d0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:21.111491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8f6054ac-6391-41a3-a478-a564eed3d084 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.083133 Sep 06 16:14:21.113506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:21 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:22.135146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a95fbb9-c7bd-4c0c-83b9-a932ffad5412 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8ed9430>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:22.210773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a95fbb9-c7bd-4c0c-83b9-a932ffad5412 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 288 microversion: 2.1 time: 0.085961 Sep 06 16:14:22.211431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:22 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:14:22.233352 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-23387472-020b-4379-9c0d-b333abe80c8d tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e61790>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:22.423020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-23387472-020b-4379-9c0d-b333abe80c8d tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 202 len: 0 microversion: 2.1 time: 0.195596 Sep 06 16:14:22.424742 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Sep 6 16:14:22 2022] DELETE /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:14:22.434323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-791da68c-44f9-4c63-8672-a3fe56a85858 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e61550>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:22.526552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-791da68c-44f9-4c63-8672-a3fe56a85858 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 200 len: 287 microversion: 2.1 time: 0.096864 Sep 06 16:14:22.527898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:22 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:22.942453 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1135256683", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:23.183289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] validate_networks() for [('18191309-c07b-4655-99ce-5637e61da145', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:14:23.269488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-348515a0-cacd-4ae1-a275-3d4f07919a12 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b8ed9310>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:23.485787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-348515a0-cacd-4ae1-a275-3d4f07919a12 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f17be063-7e6f-48cf-a010-ee458134eed9" status: 200 len: 350 microversion: 2.1 time: 0.227176 Sep 06 16:14:23.503832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:23 2022] GET /compute/v2.1/os-volumes/f17be063-7e6f-48cf-a010-ee458134eed9 => generated 350 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:23.515427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7ec90bfb-197a-4f31-8ee9-357b24c49237 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b8ed9940>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:23.887773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7ec90bfb-197a-4f31-8ee9-357b24c49237 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.381123 Sep 06 16:14:23.890319 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 15/26] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Sep 6 16:14:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:23.929433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f7487590-d119-4e5a-9ccb-2d9511814ce4 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e613a0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:24.007783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-f7487590-d119-4e5a-9ccb-2d9511814ce4 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] HTTP exception thrown: Snapshot a4b8ea7b-9964-487f-b8f7-c18b58cfef72 could not be found. Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f7487590-d119-4e5a-9ccb-2d9511814ce4 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Request method failure captured: Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 HTTP/1.1 Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HRSgQSUePkb5RAB_lbBF8YDVLhNhBaYIdYvWqXgO_dfgIwSC9ry_cKw1Rz89ftqt4nv3xKSr1iP-vn2FOHyI23P5JIqfnbzrxwsdotpS1G3_UYqRRQsmCIVaf2FmnLmv_JBtMOE1CExekytLGDml2v3nlcyPAKW0O82pdbjAZyRo4 Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:14:24.016823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: c7e629d1f7ec43d8af4fbff93b6bffad Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Snapshot a4b8ea7b-9964-487f-b8f7-c18b58cfef72 could not be found. Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'a4b8ea7b-9964-487f-b8f7-c18b58cfef72'} Sep 06 16:14:24.020473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a4b8ea7b-9964-487f-b8f7-c18b58cfef72 could not be found. (HTTP 404) (Request-ID: req-d6cae3a4-f056-4512-8c29-9ce2e45c8f49) Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:24.025206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:24.028275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a4b8ea7b-9964-487f-b8f7-c18b58cfef72 could not be found. Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 16:14:24.032775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a4b8ea7b-9964-487f-b8f7-c18b58cfef72 could not be found. Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a4b8ea7b-9964-487f-b8f7-c18b58cfef72 could not be found. Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f7487590-d119-4e5a-9ccb-2d9511814ce4 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Returning 404 to user: Snapshot a4b8ea7b-9964-487f-b8f7-c18b58cfef72 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:14:24.044686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f7487590-d119-4e5a-9ccb-2d9511814ce4 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72" status: 404 len: 111 microversion: 2.1 time: 0.119922 Sep 06 16:14:24.047324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 16/27] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:14:23 2022] GET /compute/v2.1/os-snapshots/a4b8ea7b-9964-487f-b8f7-c18b58cfef72 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:14:24.051284 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bd59d93e-01b4-40b1-b685-f641a9fc295a tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b8ed9280>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:24.573246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bd59d93e-01b4-40b1-b685-f641a9fc295a tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.534730 Sep 06 16:14:24.574519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 17/28] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Sep 6 16:14:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:24.580044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-76911aee-42e4-4ca3-bd92-d7c73acfd768 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8ed94c0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:24.826894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-76911aee-42e4-4ca3-bd92-d7c73acfd768 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 202 len: 0 microversion: 2.1 time: 0.249797 Sep 06 16:14:24.827522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 18/29] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:14:24 2022] DELETE /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:14:24.835053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a8a7f7ee-f8c4-498b-99ed-d11de7f6c614 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b8ed9af0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:25.076620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a8a7f7ee-f8c4-498b-99ed-d11de7f6c614 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.247814 Sep 06 16:14:25.077218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 19/30] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Sep 6 16:14:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:25.083582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d1dfe3fa-6ca9-4f42-a76a-83ae89ce0154 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8e4a0d0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:25.294053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d1dfe3fa-6ca9-4f42-a76a-83ae89ce0154 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 200 len: 344 microversion: 2.1 time: 0.215495 Sep 06 16:14:25.302224 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 20/31] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:25 2022] GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 344 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:25.614815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1452635168", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "networks": [{"uuid": "bc88676f-6261-4819-80a1-e8db7d54e0c7"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:25.732963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:14:25.733689 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:14:25.734605 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:14:25.735143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:14:25.735653 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:14:25.763376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:25.764636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:25.765482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:25.766568 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:25.767053 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:25.767569 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:25.829804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] validate_networks() for [('bc88676f-6261-4819-80a1-e8db7d54e0c7', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:14:25.833966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:14:25.849704 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for user eda6839efaab4317a0eda1f47f1656a2 and project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:14:25.883368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:14:25.894494 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:14:26.085999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6d2b8ec0-8818-42aa-8602-5bb9e70c0493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.036699 Sep 06 16:14:26.086762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 12/32] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:14:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 4038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:14:26.101697 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-094680c8-7442-46d4-9ea1-67723379b86a tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b84ea0d0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:26.304638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-094680c8-7442-46d4-9ea1-67723379b86a tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.215367 Sep 06 16:14:26.304854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 13/33] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Sep 6 16:14:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:26.527476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-67d14b06-9d86-466f-94b3-c7aafd53271b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: .version_select at 0x7f21b8e49c10>, body: {"keypair": {"name": "tempest-keypair-1317956596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgDvts48mFMpER1ETbqvXVQVkXgBcriO//Zuu5L40JZ49dEf7t5KiF9uXZJJXp7uK5WwRGBOIdOx+ohEFFYH07mP0AtKPGAHXUzMZX3fEd/Whwbk2n8KmUYEljAaWUdjg=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:26.598399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-67d14b06-9d86-466f-94b3-c7aafd53271b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:14:26.608310 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-67d14b06-9d86-466f-94b3-c7aafd53271b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:14:26.779792 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-67d14b06-9d86-466f-94b3-c7aafd53271b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.473372 Sep 06 16:14:26.792087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 14/34] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:14:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:26.807261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e054d2ec-1fee-4517-9698-edd45fbe73d0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:26.812422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e054d2ec-1fee-4517-9698-edd45fbe73d0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:27.120130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e054d2ec-1fee-4517-9698-edd45fbe73d0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:27.255513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e054d2ec-1fee-4517-9698-edd45fbe73d0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1222 microversion: 2.1 time: 0.463785 Sep 06 16:14:27.258752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 15/35] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:26 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1222 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:27.287087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-47382c0e-8620-4c91-9396-fe27d381fb83 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b84e2f70>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:27.553784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:14:27.555256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:14:27.556073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:14:27.556817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:14:27.557711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:14:27.562224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-47382c0e-8620-4c91-9396-fe27d381fb83 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 200 len: 344 microversion: 2.1 time: 0.301346 Sep 06 16:14:27.563436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 16/36] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:27 2022] GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 344 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:27.569132 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0a1c9589-61fa-4949-b514-e27c3fea4330 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b84a0700>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:27.616372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:27.618907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:27.620355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:27.624893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:27.627175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:27.628791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:27.750516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Getting quotas for project c5974f0b22a7493da25b0b0aaa21c66b. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:14:27.782649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Getting quotas for user 668452994ad942069d30f4bddbba15b4 and project c5974f0b22a7493da25b0b0aaa21c66b. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:14:27.824839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:14:27.833261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:14:27.881564 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0a1c9589-61fa-4949-b514-e27c3fea4330 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.316841 Sep 06 16:14:27.882844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 17/37] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Sep 6 16:14:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:27.887353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1291784654", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:28.053046 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7a0264ff-6eb1-4992-97f0-8bee162c3c35 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.753984 Sep 06 16:14:28.057625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 21/38] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:14:28.099708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5e14724b-1282-4e96-b190-9bc1398d0ade tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b8d3de50>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:28.146532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] validate_networks() for [('18191309-c07b-4655-99ce-5637e61da145', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:14:29.020607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5e14724b-1282-4e96-b190-9bc1398d0ade tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.953096 Sep 06 16:14:29.022281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Sep 6 16:14:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:29.043800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-33f5dd6f-41b5-4f2c-bd7e-04f4088370ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:29.052933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-33f5dd6f-41b5-4f2c-bd7e-04f4088370ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:29.387546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-33f5dd6f-41b5-4f2c-bd7e-04f4088370ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:29.422550 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-33f5dd6f-41b5-4f2c-bd7e-04f4088370ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1215 microversion: 2.1 time: 0.398808 Sep 06 16:14:29.427985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 23/40] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:29 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1215 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:29.439063 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a4d8ab33-a79a-4639-8e9b-c84b825f9b0a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8d58ee0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:29.543416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-a4d8ab33-a79a-4639-8e9b-c84b825f9b0a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] HTTP exception thrown: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a4d8ab33-a79a-4639-8e9b-c84b825f9b0a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Request method failure captured: Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d HTTP/1.1 Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HRSgQSUePkb5RAB_lbBF8YDVLhNhBaYIdYvWqXgO_dfgIwSC9ry_cKw1Rz89ftqt4nv3xKSr1iP-vn2FOHyI23P5JIqfnbzrxwsdotpS1G3_UYqRRQsmCIVaf2FmnLmv_JBtMOE1CExekytLGDml2v3nlcyPAKW0O82pdbjAZyRo4 Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:14:29.547175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: c7e629d1f7ec43d8af4fbff93b6bffad Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d'} Sep 06 16:14:29.548590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. (HTTP 404) (Request-ID: req-f6cfe6ec-90a2-425c-8e9d-bda6d0d0f031) Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:29.550136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:29.551466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:14:29.552490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a4d8ab33-a79a-4639-8e9b-c84b825f9b0a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Returning 404 to user: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a4d8ab33-a79a-4639-8e9b-c84b825f9b0a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 404 len: 109 microversion: 2.1 time: 0.120134 Sep 06 16:14:29.553808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 24/41] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:29 2022] GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 109 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:14:29.579259 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-15441315-f2d4-4ba5-bea3-8c6be1064586 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b85150d0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:29.982002 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-15441315-f2d4-4ba5-bea3-8c6be1064586 tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.418538 Sep 06 16:14:29.983096 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 25/42] 10.222.0.26 () {58 vars in 1188 bytes} [Tue Sep 6 16:14:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:29.990073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e54eebb3-c8c5-4a25-8f58-d39500905c4a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8d58700>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:30.173824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-e54eebb3-c8c5-4a25-8f58-d39500905c4a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] HTTP exception thrown: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e54eebb3-c8c5-4a25-8f58-d39500905c4a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Request method failure captured: Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d HTTP/1.1 Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HRSgQSUePkb5RAB_lbBF8YDVLhNhBaYIdYvWqXgO_dfgIwSC9ry_cKw1Rz89ftqt4nv3xKSr1iP-vn2FOHyI23P5JIqfnbzrxwsdotpS1G3_UYqRRQsmCIVaf2FmnLmv_JBtMOE1CExekytLGDml2v3nlcyPAKW0O82pdbjAZyRo4 Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:14:30.176414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: c7e629d1f7ec43d8af4fbff93b6bffad Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d'} Sep 06 16:14:30.177518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. (HTTP 404) (Request-ID: req-2f9c2032-5c7b-4285-b35b-440109571f30) Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:30.178231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:14:30.181958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 16:14:30.183021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e54eebb3-c8c5-4a25-8f58-d39500905c4a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Returning 404 to user: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e54eebb3-c8c5-4a25-8f58-d39500905c4a tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 404 len: 109 microversion: 2.1 time: 0.193712 Sep 06 16:14:30.184053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 26/43] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:14:29 2022] DELETE /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:14:30.194592 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-87e965e1-655d-4db4-8b50-19f7727dcc6d tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] Calling method '.version_select at 0x7f21b849d040>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:30.841798 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-87e965e1-655d-4db4-8b50-19f7727dcc6d tempest-VolumesTestJSON-2070642872 tempest-VolumesTestJSON-2070642872-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.661347 Sep 06 16:14:30.843711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 27/44] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Sep 6 16:14:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:30.851160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-de20d1bb-a6ec-4daf-9ad0-04bafd5d45a7 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Calling method '.version_select at 0x7f21b8d58ee0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:31.048649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:14:31.053193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:14:31.057915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:14:31.059246 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:14:31.062427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:14:31.103315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:31.107118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:31.108051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:31.109967 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:31.114026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:31.115317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:31.172648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:14:31.180245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for user eda6839efaab4317a0eda1f47f1656a2 and project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:14:31.228411 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:14:31.238913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:14:31.329011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-de20d1bb-a6ec-4daf-9ad0-04bafd5d45a7 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] HTTP exception thrown: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-de20d1bb-a6ec-4daf-9ad0-04bafd5d45a7 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Request method failure captured: Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d HTTP/1.1 Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HRSgQSUePkb5RAB_lbBF8YDVLhNhBaYIdYvWqXgO_dfgIwSC9ry_cKw1Rz89ftqt4nv3xKSr1iP-vn2FOHyI23P5JIqfnbzrxwsdotpS1G3_UYqRRQsmCIVaf2FmnLmv_JBtMOE1CExekytLGDml2v3nlcyPAKW0O82pdbjAZyRo4 Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:14:31.331994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/43dcc617cde94adf87bfa665e6cfa39c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 43dcc617cde94adf87bfa665e6cfa39c Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1359292884 Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: c7e629d1f7ec43d8af4fbff93b6bffad Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1359292884-project Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d'} Sep 06 16:14:31.333321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. (HTTP 404) (Request-ID: req-5b55b8e0-e05a-48c1-bdd1-835f4a5f9c2b) Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:31.333957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:14:31.334920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:14:31.335867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. Sep 06 16:14:31.336771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:14:31.340587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-de20d1bb-a6ec-4daf-9ad0-04bafd5d45a7 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] Returning 404 to user: Volume b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:14:31.342157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-de20d1bb-a6ec-4daf-9ad0-04bafd5d45a7 tempest-VolumesSnapshotsTestJSON-1359292884 tempest-VolumesSnapshotsTestJSON-1359292884-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d" status: 404 len: 109 microversion: 2.1 time: 0.496574 Sep 06 16:14:31.343584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 28/45] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:14:30 2022] GET /compute/v2.1/os-volumes/b544f4e7-c0fe-4d72-b5f2-bf1a7af31d1d => generated 109 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:14:31.383146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:31.390713 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:31.442786 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:31.444545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:31.467358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:31.473213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:31.477443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:31.479874 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:31.513263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-18d387ff-7b07-4bf7-95c9-6ce04f8564e1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.620164 Sep 06 16:14:31.526397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 18/46] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:14:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:14:31.552238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8c0277c9-aece-4f21-a07d-3716e46dd88c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:31.571333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8c0277c9-aece-4f21-a07d-3716e46dd88c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:32.808597 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8c0277c9-aece-4f21-a07d-3716e46dd88c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:32.837028 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8c0277c9-aece-4f21-a07d-3716e46dd88c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1222 microversion: 2.1 time: 1.305932 Sep 06 16:14:32.843822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 19/47] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:31 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1222 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:32.907398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:32.961208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-53519a5d-edab-4b90-8c1c-9765edbbffbd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1211 microversion: 2.1 time: 1.614458 Sep 06 16:14:32.963092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 29/48] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:31 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1211 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:33.892119 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:33.895241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:33.944898 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:33.946242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:33.950113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:33.989228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:33.996080 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:34.004747 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:34.035788 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:34.036998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:34.122996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:34.124676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:34.125721 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:34.135854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:34.138611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:34.141953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:34.546549 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:34.600998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ca07fbb7-290d-49f4-8855-e9abe0c91617 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1273 microversion: 2.1 time: 0.579287 Sep 06 16:14:34.621639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 30/49] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:33 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1273 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:35.442429 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:35.517470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1e231868-a93d-486b-860c-2d1241d74cb8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1218 microversion: 2.1 time: 1.630431 Sep 06 16:14:35.525602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 20/50] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:33 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1218 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:35.671054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:35.676066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:35.725676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:35.727989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:35.732580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:35.738777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:35.742478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:35.767460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:36.152628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-640893360", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5719a142-0389-455c-a92f-618471f11ba9"}], "security_groups": [{"name": "tempest-securitygroup--1240346465"}], "key_name": "tempest-keypair-1317956596", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:36.176203 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:36.213804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-15eb49df-bcbb-4cf4-9137-2fcdcd17869b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1273 microversion: 2.1 time: 0.557430 Sep 06 16:14:36.219390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 31/51] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:35 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1273 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:36.560949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:36.563062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:36.580814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:36.582058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:36.589504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:36.591544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:36.593731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:36.597646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:36.867008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:36.919086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c5168b5c-cf4e-46b4-a3ee-f619d92bd7fe tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1218 microversion: 2.1 time: 0.368512 Sep 06 16:14:36.930213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 32/52] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:36 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1218 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:37.259472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:37.260544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:37.280158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:37.280885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:37.282364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:37.288327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:37.294842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:37.295458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:37.332435 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] validate_networks() for [('5719a142-0389-455c-a92f-618471f11ba9', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:14:37.486039 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:37.533027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2c5bea68-091a-41c2-946b-93c9fc23108f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1273 microversion: 2.1 time: 0.277808 Sep 06 16:14:37.550975 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 33/53] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:37 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:37.985818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:37.993593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:37.996053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:38.016968 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:38.022745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:38.023507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:38.025783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:38.026718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:38.031152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:38.241331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:38.265657 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-73f002a8-b8c2-481e-a468-581a7dded495 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1274 microversion: 2.1 time: 0.303230 Sep 06 16:14:38.269187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 34/54] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:37 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:38.587029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:38.587029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:38.607457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:38.613105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:38.616168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:38.628147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:38.629459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:38.631121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:38.772008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:38.786418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e41f732d-1685-433e-8167-87c3598c69c5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1273 microversion: 2.1 time: 0.210933 Sep 06 16:14:38.803414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 35/55] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:38 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:39.302231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:39.303408 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:39.320500 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:39.324453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:39.325168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:39.329670 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:39.334371 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:39.335162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:39.485092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=8 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:39.922967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:39.959226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f8234a2c-9842-47c1-a909-e4307ca05862 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1282 microversion: 2.1 time: 0.655522 Sep 06 16:14:39.960678 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 36/56] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:39 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1282 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:39.992333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:39.993362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:40.032631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:40.033725 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:40.034738 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:40.035997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:40.036818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:40.058927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:40.739551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:40.783041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-93672ead-1aff-42af-aff7-e2346733b30d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1273 microversion: 2.1 time: 0.812741 Sep 06 16:14:40.784739 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 37/57] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:39 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1273 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:41.025159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:41.033091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:41.117877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:41.119012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:41.120514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:41.124097 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:41.128679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:41.130894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:41.154517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=4 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:41.629978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:41.658553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a986414f-d887-4b4d-96ca-74ea4b8f0b1e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1280 microversion: 2.1 time: 0.649061 Sep 06 16:14:41.662736 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 38/58] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:40 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1280 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:41.840688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:41.845095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:41.867712 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:41.870055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:41.875481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:41.882228 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:41.883016 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:41.883717 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:41.916341 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:14:41.917180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:14:41.917871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:14:41.918470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:14:41.919095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:14:41.950608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:41.951213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:41.951727 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:41.954524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:41.960196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:41.962552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:42.054348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:14:42.062982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:14:42.093358 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:14:42.097110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:14:42.389710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-96b73189-db26-42a0-bf50-9dc3189786b3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.252458 Sep 06 16:14:42.410007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 21/59] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:14:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 6273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:14:42.420538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e62e2606-2ffc-47ad-98aa-974c53e90cc6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:42.432190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e62e2606-2ffc-47ad-98aa-974c53e90cc6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:42.811406 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:42.822020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cefcf559-6042-4e63-aead-134e483496ae tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.986312 Sep 06 16:14:42.831026 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 39/60] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:41 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:42.848992 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e62e2606-2ffc-47ad-98aa-974c53e90cc6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:42.859009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e62e2606-2ffc-47ad-98aa-974c53e90cc6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1241 microversion: 2.1 time: 0.447610 Sep 06 16:14:42.864728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:42.868737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 22/61] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:42 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1241 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:42.873199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:42.899563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:42.900011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:42.900515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:42.911735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:42.915148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:42.915766 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:43.392533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:43.427402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-64e8d8c2-56c0-495a-a854-32206b8f2d1a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1280 microversion: 2.1 time: 0.594554 Sep 06 16:14:43.429858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 40/62] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:42 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1280 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:43.877230 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:43.882454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:43.920233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:43.922235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-157d34fc-e956-473d-b98c-9040c09b94e8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:43.923366 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:43.927546 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:43.928370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-157d34fc-e956-473d-b98c-9040c09b94e8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:43.950783 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:43.960942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:43.964197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:44.058865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-157d34fc-e956-473d-b98c-9040c09b94e8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:44.113121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-157d34fc-e956-473d-b98c-9040c09b94e8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1241 microversion: 2.1 time: 0.195649 Sep 06 16:14:44.119041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 41/63] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:43 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1241 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:44.512810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:44.519261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:44.571270 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:44.572237 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:44.573062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:44.587528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:44.594424 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:44.598857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:45.707757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:45.716675 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-94f7124f-f8af-4507-8bff-b4c3c4e80530 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 1.247279 Sep 06 16:14:45.741248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 42/64] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:44 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:45.759829 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:45.760381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:45.823515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:45.826324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:45.834746 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:45.840757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:45.847022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:45.869019 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:46.405692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:46.415313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-74e79b74-dd4a-4c3f-b45d-8e271bb6a492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1293 microversion: 2.1 time: 0.672652 Sep 06 16:14:46.438418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 43/65] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:45 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1293 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:46.766604 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:46.774981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:46.801049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:46.802045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:46.803473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:46.804478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:46.806525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:46.807677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:47.203333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:47.219865 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0d09f931-4dec-4c7c-9777-b72fe20ba785 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 3.367440 Sep 06 16:14:47.225565 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 23/66] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:43 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 3376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:47.466948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:47.467746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:47.495779 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:47.496482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:47.497345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:47.500154 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:47.509148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:47.515056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:48.142217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:48.174196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-08c1597d-aa4d-4bde-8383-1e32e72d42ef tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1299 microversion: 2.1 time: 0.711111 Sep 06 16:14:48.180480 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 24/67] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:47 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1299 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:48.285268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:48.291882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:48.331999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:48.338162 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:48.372794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:48.374744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:48.375857 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:48.377579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:48.416809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:48.480220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bbf17db3-4943-447e-8af8-3b6b8150eebf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 1.728675 Sep 06 16:14:48.512857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 44/68] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:46 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:49.244170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:49.254183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:49.300351 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:49.304509 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:49.308684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:49.314684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:49.316821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:49.321074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:49.380466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:49.402282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2785c8e2-4300-42aa-a724-6f7124dcc64f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 1.125460 Sep 06 16:14:49.432014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 25/69] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:48 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:49.516827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:49.520627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:49.539308 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:49.540797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:49.542162 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:49.543995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:49.545241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:49.547466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:50.461534 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:50.480027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ee6e17ff-be14-475a-b233-93c0d2055f25 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1299 microversion: 2.1 time: 1.245154 Sep 06 16:14:50.483604 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 45/70] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:49 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1299 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:50.500788 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:50.501568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:50.521294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:50.521803 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:50.522335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:50.540818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:50.540818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:50.543462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:50.560426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:51.005180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:51.020256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=35 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:51.088581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-39f8ddc8-fc9f-4edd-a965-860c53180d46 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 1.576319 Sep 06 16:14:51.107371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 26/71] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:49 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:51.440914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:51.456836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2b7c282e-94f7-498e-86d5-9c928f3dd2cd tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.971949 Sep 06 16:14:51.475737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 46/72] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:50 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:51.539698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:51.540707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:51.546771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:51.561752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:51.564259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:51.568574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:51.569777 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:51.572277 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:51.573168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:51.976145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:52.205740 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:52.242728 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7068cc6d-239b-493e-bb15-0bb18b7cc808 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1299 microversion: 2.1 time: 0.706338 Sep 06 16:14:52.262692 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 27/73] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:51 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1299 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:52.304882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:52.306290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:52.339358 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:52.340403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:52.343361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:52.345887 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:52.346494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-a4f63d2e-e718-4581-8a37-e16e03a556cc req-7419cabf-1d84-4070-8d51-8df3d1c53b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec48627-7548-4e6c-87fd-4a024c9a5f40", "tag": "6439cdc1-f69f-4086-af0b-645e3e86f015"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:52.349213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:52.349663 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:52.381140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:52.406008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a4f63d2e-e718-4581-8a37-e16e03a556cc req-7419cabf-1d84-4070-8d51-8df3d1c53b5f service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:52.406276 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a4f63d2e-e718-4581-8a37-e16e03a556cc req-7419cabf-1d84-4070-8d51-8df3d1c53b5f service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:52.407215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a4f63d2e-e718-4581-8a37-e16e03a556cc req-7419cabf-1d84-4070-8d51-8df3d1c53b5f service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:52.490250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-a4f63d2e-e718-4581-8a37-e16e03a556cc req-7419cabf-1d84-4070-8d51-8df3d1c53b5f service nova] Creating event network-changed:6439cdc1-f69f-4086-af0b-645e3e86f015 for instance eec48627-7548-4e6c-87fd-4a024c9a5f40 on hv-cinder-85220 Sep 06 16:14:52.492998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a4f63d2e-e718-4581-8a37-e16e03a556cc req-7419cabf-1d84-4070-8d51-8df3d1c53b5f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 16:14:52.494155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a4f63d2e-e718-4581-8a37-e16e03a556cc req-7419cabf-1d84-4070-8d51-8df3d1c53b5f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 16:14:52.497718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:52.500053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:52.501522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:52.505196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:52.506479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:52.507978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:52.533925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.compute.rpcapi [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 16:14:52.537131 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] Releasing lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 16:14:52.641608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b02dcba1-674c-4c3c-9d5f-e3e16b2d030a None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.745202 Sep 06 16:14:52.645417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 47/74] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:52.664311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:52.666961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:52.681177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:52.682690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:52.683897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:52.685664 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:52.687463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:52.688631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:52.860111 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=28 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:53.184550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:53.220027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-48c5362a-26aa-40ec-954e-0d594fbe0fe7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.927356 Sep 06 16:14:53.232641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 28/75] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:52 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:53.310579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:53.312510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:53.366528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:53.375921 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:53.376649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:53.378039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:53.390043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:53.402780 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cadcffe2-3234-4e7d-8ac6-91f2a5967b4f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.754586 Sep 06 16:14:53.403942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:53.404886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:53.417585 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 48/76] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:52 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:54.187930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:54.208761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4738d859-1368-40f5-abb4-1659aa6d1d08 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.903807 Sep 06 16:14:54.212617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 29/77] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:53 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:54.269232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:54.274212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:54.296725 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:14:54.300436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:54.312666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:54.315600 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:54.335015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:54.338762 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:54.341767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:54.436228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:54.437761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:54.452184 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:54.457381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:54.458108 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:54.459937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:54.461465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:54.462682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:55.411675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:55.449530 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3f4caaf7-a932-45f7-ad35-1ca7a0cc3069 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 1.017283 Sep 06 16:14:55.450726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 30/78] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:54 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:55.470483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-aadd33e9-bf1b-420d-ae89-bf9f40ba24ec req-3f070d95-6cac-4a66-9b32-b4b83840b646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e574f9ab-e5b1-4762-bf2e-211d8fd993fa", "tag": "18d7ddf0-d73b-4db0-8dca-21e9889e695f"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:55.531390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aadd33e9-bf1b-420d-ae89-bf9f40ba24ec req-3f070d95-6cac-4a66-9b32-b4b83840b646 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:55.532190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aadd33e9-bf1b-420d-ae89-bf9f40ba24ec req-3f070d95-6cac-4a66-9b32-b4b83840b646 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:55.533978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aadd33e9-bf1b-420d-ae89-bf9f40ba24ec req-3f070d95-6cac-4a66-9b32-b4b83840b646 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:55.594604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-aadd33e9-bf1b-420d-ae89-bf9f40ba24ec req-3f070d95-6cac-4a66-9b32-b4b83840b646 service nova] Creating event network-changed:18d7ddf0-d73b-4db0-8dca-21e9889e695f for instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa on hv-cinder-85220 Sep 06 16:14:55.595423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aadd33e9-bf1b-420d-ae89-bf9f40ba24ec req-3f070d95-6cac-4a66-9b32-b4b83840b646 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 16:14:55.603084 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aadd33e9-bf1b-420d-ae89-bf9f40ba24ec req-3f070d95-6cac-4a66-9b32-b4b83840b646 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 16:14:55.607346 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:55.607861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:55.608595 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:55.609101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:55.611525 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:55.612729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:55.634880 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.compute.rpcapi [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 16:14:55.637552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120738) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 16:14:55.668533 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-406e5485-77b3-4d18-b9f4-0c3138f43ba2 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210720 Sep 06 16:14:55.669428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 31/79] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:55.784570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:55.798545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-871ce0c0-c233-4e44-80e0-a09694c30150 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 1.539049 Sep 06 16:14:55.800277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 49/80] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:54 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:55.830104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:55.833144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:55.848922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:55.850065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:55.851250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:55.853678 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:55.855031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:55.856003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:55.922536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-aa81ce77-496b-4abd-8823-f3a44244f2f8 req-a73e62de-f4e6-4afe-85ae-6533fa7b69b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fbd0bbd-012b-4497-a8e2-247e7cfd22cd", "tag": "238bad90-5526-4449-82a2-c985d1021f8a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:55.936240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aa81ce77-496b-4abd-8823-f3a44244f2f8 req-a73e62de-f4e6-4afe-85ae-6533fa7b69b1 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:55.937338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aa81ce77-496b-4abd-8823-f3a44244f2f8 req-a73e62de-f4e6-4afe-85ae-6533fa7b69b1 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:55.937893 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-aa81ce77-496b-4abd-8823-f3a44244f2f8 req-a73e62de-f4e6-4afe-85ae-6533fa7b69b1 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:55.953303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-aa81ce77-496b-4abd-8823-f3a44244f2f8 req-a73e62de-f4e6-4afe-85ae-6533fa7b69b1 service nova] Creating event network-changed:238bad90-5526-4449-82a2-c985d1021f8a for instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd on hv-cinder-85220 Sep 06 16:14:55.960616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-aa81ce77-496b-4abd-8823-f3a44244f2f8 req-a73e62de-f4e6-4afe-85ae-6533fa7b69b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288836 Sep 06 16:14:55.962025 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 32/81] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:56.483086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:56.487541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:56.511882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:56.523271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:56.524638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:56.527032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:56.534048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:56.535353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:56.845918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:56.874833 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a0d88fb1-6d8e-43e0-a9bf-b2e3bdd43d06 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 1.057801 Sep 06 16:14:56.875954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 50/82] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:55 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:56.892275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:56.905118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:56.942209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:56.949513 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:56.954636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:56.961325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:56.966152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:56.968577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:57.040726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:57.078196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4f9a8c23-e3bb-497f-b52b-fb23cfd10211 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.600163 Sep 06 16:14:57.082624 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 33/83] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:56 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:57.867116 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:57.893480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f5a1a7bb-60aa-4601-87d1-ef5c16466198 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 1.010979 Sep 06 16:14:57.894621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 51/84] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:56 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:57.940322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:57.944784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:57.964853 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:57.975735 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:57.976856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:57.978416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:57.979541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:57.983577 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:58.113701 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:58.116269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:58.141019 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:58.141920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:58.148077 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:58.164905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:58.170218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:58.173506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:58.539717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:58.553217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a4ef5676-493d-4224-ac83-9e4626e373c6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.626221 Sep 06 16:14:58.567561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 34/85] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:57 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:14:58.581152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-5258c36f-839e-4c9d-aca2-8551f6bfd951 req-dc97c6b5-57bc-4011-8e49-7066f0602688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75eba83a-9a4e-46fb-854b-17e2f53a0444", "tag": "287e2c73-e48f-47ca-97ed-0553597da139"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:14:58.610968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5258c36f-839e-4c9d-aca2-8551f6bfd951 req-dc97c6b5-57bc-4011-8e49-7066f0602688 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:58.618456 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5258c36f-839e-4c9d-aca2-8551f6bfd951 req-dc97c6b5-57bc-4011-8e49-7066f0602688 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:58.619519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5258c36f-839e-4c9d-aca2-8551f6bfd951 req-dc97c6b5-57bc-4011-8e49-7066f0602688 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:58.638745 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-5258c36f-839e-4c9d-aca2-8551f6bfd951 req-dc97c6b5-57bc-4011-8e49-7066f0602688 service nova] Creating event network-changed:287e2c73-e48f-47ca-97ed-0553597da139 for instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 on hv-cinder-85220 Sep 06 16:14:58.665670 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-5258c36f-839e-4c9d-aca2-8551f6bfd951 req-dc97c6b5-57bc-4011-8e49-7066f0602688 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095391 Sep 06 16:14:58.667418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 35/86] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:14:58.808826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:58.824590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1d650ab3-11f0-46c7-aec9-43d729e01b23 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.718110 Sep 06 16:14:58.831686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 52/87] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:58 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:58.926109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:58.926944 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:58.934730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:58.936849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:58.937989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:58.939128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:58.940204 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:58.940773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:59.202810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:14:59.212649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eef8eb1e-bdc5-4ac8-8bc6-d2ab063d75c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.291746 Sep 06 16:14:59.213945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 36/88] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:58 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:14:59.584581 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:59.586245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:59.603352 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:59.604323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:59.605625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:59.607669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:59.608423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:59.609141 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:59.874298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:14:59.875423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:14:59.897797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:59.898487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:59.899127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:14:59.901527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:14:59.902473 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:14:59.904346 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:00.125655 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:00.135691 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6681e673-d610-4f4c-a823-126da3c533f0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.558831 Sep 06 16:15:00.150845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 53/89] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:59 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:00.180537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:00.197677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6e778edb-6b87-4816-b5da-a0ee218825ca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.327019 Sep 06 16:15:00.198946 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 37/90] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:14:59 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:00.255817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:00.256460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:00.266113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:00.267236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:00.268442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:00.269612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:00.270288 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:00.270958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:00.681561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:00.693296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a01de8a8-a2f2-4576-ba35-53120fb5884e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.442139 Sep 06 16:15:00.693986 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 54/91] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:00 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:01.167985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:01.169579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:01.184894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:01.187998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:01.189127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:01.191084 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:01.192157 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:01.193390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:01.227669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:01.228776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:01.263401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:01.265390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:01.265969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:01.266939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:01.268241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:01.268929 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:01.505623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:01.519534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8039372e-79c4-4458-a214-aff5c65b234d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.358866 Sep 06 16:15:01.539695 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 38/92] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:01 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:01.641414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:01.651329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9b50930a-3bb8-4753-bce8-008b7b33a2d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.431260 Sep 06 16:15:01.651937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 55/93] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:01 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:01.719739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:01.721418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:01.730192 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:01.731465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:01.731972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:01.732913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:01.733608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:01.734380 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:02.022156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:02.031407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3cd5b86d-448b-4495-a5ad-121e3ed2d462 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.316508 Sep 06 16:15:02.032574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 39/94] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:01 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:02.572478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:02.574649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:02.586395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:02.590322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:02.591367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:02.592784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:02.594332 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:02.596130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:02.597660 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:02.696838 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:02.701165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:02.743776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:02.744734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:02.745459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:02.746927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:02.747711 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:02.748458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:02.990049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:03.016612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3987b101-0686-4776-882f-027bbe772b58 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.459819 Sep 06 16:15:03.020215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 56/95] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:02 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:03.085203 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:03.086711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:03.091027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:03.104184 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6d1c82e9-e7fa-4317-bc44-79b2e2904c79 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.417139 Sep 06 16:15:03.110825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 40/96] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:02 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:03.119437 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:03.121245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:03.122050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:03.123067 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:03.124452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:03.125357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:03.404043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:03.413124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b08cb598-588e-4b9c-b54c-6e1fc77dcf56 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.337600 Sep 06 16:15:03.413725 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 57/97] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:03 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:04.066558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:04.077402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:04.107861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:04.108521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:04.109097 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:04.110418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:04.110990 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:04.112225 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:04.161985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:04.165022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:04.176693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:04.177765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:04.178649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:04.180334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:04.181703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:04.182833 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:04.488363 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:04.508551 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9bc11b82-c6d8-40ea-92a4-9f26888bc622 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.453165 Sep 06 16:15:04.510371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 41/98] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:04 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:04.519970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:04.521375 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:04.533779 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:04.535244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:04.536542 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:04.538256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:04.540839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:04.542794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:04.634881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:04.682787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ec6a8d91-7d35-46b2-bfef-aca89baa713c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.535512 Sep 06 16:15:04.690597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 58/99] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:04 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:04.898030 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:04.921311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b66144f7-9195-4417-8216-ed3388734104 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.408685 Sep 06 16:15:04.943920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 42/100] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:04 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:05.549238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:05.550617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:05.561418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:05.566501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:05.567007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:05.567806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:05.568430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:05.570109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:05.732354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:05.733205 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:05.747638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:05.750636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:05.755454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:05.757545 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:05.758699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:05.761344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:05.765174 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:06.112668 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:06.130540 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:06.145489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0c214bae-fe62-4df4-862c-1e14629c86e9 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.416716 Sep 06 16:15:06.146086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-124e9895-77d0-4ae3-81ea-c11f5d2e6aa7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.602069 Sep 06 16:15:06.149271 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 59/101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:05 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:06.162615 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 43/102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:05 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:06.164183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:06.165828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:06.183242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:06.190262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:06.192715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:06.194072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:06.199042 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:06.200439 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:06.521159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:06.539992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-49372b44-960d-4948-94ba-a1b9f7cfc24b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.388976 Sep 06 16:15:06.542785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 60/103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:06 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:07.191247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:07.193036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:07.199943 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:07.200725 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:07.210524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:07.212195 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:07.212447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:07.213245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:07.213863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:07.214310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:07.215477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:07.216345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:07.217392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:07.218376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:07.235181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:07.235181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:07.499460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:07.511508 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2d5d4307-79d7-4f6b-808f-c54b258c6bca tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.316019 Sep 06 16:15:07.512109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 61/104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:07 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:07.576266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:07.577116 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:07.587667 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:07.588276 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:07.588982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:07.590351 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:07.599590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:07.600425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:07.631547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:07.653824 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cfa95b9f-f3cf-430a-a9b3-a249c1547ad0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.473188 Sep 06 16:15:07.655113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 44/105] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:07 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:07.821162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:07.834730 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e413f48c-0c8d-4ee6-9ebd-8f6a3556715b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.262081 Sep 06 16:15:07.839419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 62/106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:07 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:08.568910 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:08.577640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:08.588068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:08.589322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:08.590319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:08.591953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:08.592938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:08.594027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:08.610332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:08.720197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:08.729111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:08.776006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:08.777379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:08.778619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:08.780701 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:08.782155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:08.784706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:08.794868 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:09.101522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:09.113716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ce389799-d44c-4587-bd00-372ba64075a1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.408836 Sep 06 16:15:09.114529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 63/107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:08 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:09.145115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:09.146628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:09.155539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:09.156145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:09.156832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:09.157820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:09.159425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:09.159950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:09.160425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:09.188412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-649fb896-e5a6-4638-b101-c7fbe0e54fc6 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.629138 Sep 06 16:15:09.218799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 45/108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:08 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:09.394627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:09.426291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-114ee84b-a0b6-4f5c-a068-4ff4586463e2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.293847 Sep 06 16:15:09.428017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 64/109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:09 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:10.150643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:10.151716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:10.163084 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:10.163870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:10.164492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:10.165464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:10.166513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:10.167470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:10.268153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:10.270536 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:10.284284 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:10.285557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:10.286571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:10.288281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:10.289427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:10.290566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:10.444347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:10.467772 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7e20edb0-fbd8-4962-b7cb-61eeac961bf6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.323970 Sep 06 16:15:10.484552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 46/110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:10 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:10.515951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:10.517066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:10.535765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:10.536680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:10.537497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:10.538884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:10.539731 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:10.540510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:10.592210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:10.637847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-586b3135-d02c-4c81-8248-7fa34d0a4b31 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.398975 Sep 06 16:15:10.639583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 65/111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:10 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:10.917331 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:10.929482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-478eb159-febf-4fcc-84c7-d4964bd8e95e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.443266 Sep 06 16:15:10.930413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 47/112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:10 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:11.521951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:11.523004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:11.530498 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:11.531139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:11.531844 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:11.533350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:11.536204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:11.536204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:11.684255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:11.687665 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:11.700246 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:11.701539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:11.702786 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:11.704512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:11.706446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:11.707870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:11.777384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:11.793809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f5332dd1-9572-4c4c-b9f0-ab2ca8cb84a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.276467 Sep 06 16:15:11.794959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 66/113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:11 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:11.974835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:11.976388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:11.988285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:11.989445 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:11.989655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:11.990907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:11.992435 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:11.993944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:11.995811 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:12.011483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ea47c102-58e3-4a58-83e6-565180b3790c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.330751 Sep 06 16:15:12.013146 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 48/114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:11 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:12.172549 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:12.182334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d066ab37-dc04-497c-8833-b278b9513b2a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.215210 Sep 06 16:15:12.183680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 67/115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:11 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:12.824666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:12.825347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:12.832669 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:12.833172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:12.833614 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:12.834332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:12.834833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:12.835272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:13.043151 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:13.046037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:13.058443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:13.059790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:13.060579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:13.061015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:13.063113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:13.064987 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:13.066009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:13.076067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b078ef23-17ed-4be3-8b4c-a9bb43343ca8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.255011 Sep 06 16:15:13.077413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 49/116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:12 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:13.234428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:13.240608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:13.264731 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:13.265631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:13.266491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:13.267421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:13.272792 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:13.273983 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:13.275217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:13.296564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0ad661b9-bb20-4e66-9131-ff0e51b1d891 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.260283 Sep 06 16:15:13.297601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 68/117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:13 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:13.498962 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:13.508888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-16d4dd94-dde9-4d2c-841a-9c282f5ac514 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.293729 Sep 06 16:15:13.509470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 50/118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:13 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:14.122591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:14.124838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:14.136056 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:14.137284 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:14.139209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:14.140271 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:14.141361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:14.141920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:14.340896 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-79dc267e-d67f-400f-9198-414fa1f95e2b req-a9966f40-f17f-4dea-a18f-0e45ff594b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e574f9ab-e5b1-4762-bf2e-211d8fd993fa", "name": "network-vif-plugged", "status": "completed", "tag": "18d7ddf0-d73b-4db0-8dca-21e9889e695f"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:14.342248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:14.354298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-28ae0af1-4c48-4ba0-88f3-a4565f9ef2ad tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.239545 Sep 06 16:15:14.355612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 69/119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:14 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:14.358148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-79dc267e-d67f-400f-9198-414fa1f95e2b req-a9966f40-f17f-4dea-a18f-0e45ff594b56 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:14.359213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-79dc267e-d67f-400f-9198-414fa1f95e2b req-a9966f40-f17f-4dea-a18f-0e45ff594b56 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:14.360428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-79dc267e-d67f-400f-9198-414fa1f95e2b req-a9966f40-f17f-4dea-a18f-0e45ff594b56 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:14.361628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:14.362653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:14.376615 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:14.377391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:14.378248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:14.379770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:14.380585 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:14.381322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:14.387692 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-79dc267e-d67f-400f-9198-414fa1f95e2b req-a9966f40-f17f-4dea-a18f-0e45ff594b56 service nova] Creating event network-vif-plugged:18d7ddf0-d73b-4db0-8dca-21e9889e695f for instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa on hv-cinder-85220 Sep 06 16:15:14.397726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-79dc267e-d67f-400f-9198-414fa1f95e2b req-a9966f40-f17f-4dea-a18f-0e45ff594b56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199134 Sep 06 16:15:14.399031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 51/120] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:14.540595 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:14.552139 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:14.610078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:14.612066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:14.613296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:14.618001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:14.631308 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:14.632334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:14.717209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:14.764974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f4b30cb9-814d-4673-b08f-1db33aa7e46b tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.401715 Sep 06 16:15:14.764974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 70/121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:14 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:15.044618 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:15.061745 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f55b0d1f-30c8-4768-b5db-19a5b58f6088 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.530810 Sep 06 16:15:15.063565 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 52/122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:14 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:15.390690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:15.391979 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:15.406715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:15.408392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:15.411243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:15.414291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:15.415532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:15.416452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:15.796431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:15.797730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:15.807013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:15.811485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:15.812489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:15.813606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:15.817996 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:15.820527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:16.188691 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:16.207217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8ae36982-d6f4-4e2a-a62f-590d8fdd5475 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.823063 Sep 06 16:15:16.208176 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 71/123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:15 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:16.217567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:16.219846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:16.239232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:16.239995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:16.240880 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:16.242338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:16.243563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:16.244359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:16.497539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:16.511212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9716b760-ea41-40a3-b8f2-9aa676f6a324 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.301454 Sep 06 16:15:16.511918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 72/124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:16 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:16.547621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:16.582304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1979637571", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "networks": [{"uuid": "759a6db1-4613-4095-bc4d-b82749165525"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:16.583703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-673bed85-c3fb-4b08-8580-c2dbfb51ff29 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.786032 Sep 06 16:15:16.584509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 53/125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:15 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:16.681199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] validate_networks() for [('759a6db1-4613-4095-bc4d-b82749165525', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:15:17.230246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:15:17.231030 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:15:17.232215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:15:17.233684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:15:17.234378 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:15:17.241227 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:17.243461 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:17.254233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.255290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.256469 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:17.257555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.258261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.259180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:17.260691 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.262428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.264694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:17.268666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.270088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.271101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:17.306042 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Getting quotas for project f124871e909842f4b74ef9fb483f5dd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:15:17.316308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Getting quotas for user b24f1542cddf4fc9aa8003952e26cb96 and project f124871e909842f4b74ef9fb483f5dd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:15:17.336782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:15:17.340996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:15:17.438244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d6dcb044-9482-4264-99f6-0771611ca04f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872679 Sep 06 16:15:17.439342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 73/126] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:15:17.468423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e9a8d1e1-a8f7-40d7-9f83-a3680ebd58aa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:17.469951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e9a8d1e1-a8f7-40d7-9f83-a3680ebd58aa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:17.590720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e9a8d1e1-a8f7-40d7-9f83-a3680ebd58aa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:17.594039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:17.603617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e9a8d1e1-a8f7-40d7-9f83-a3680ebd58aa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1214 microversion: 2.1 time: 0.143132 Sep 06 16:15:17.605149 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 74/127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:17 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:17.633993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0a660aea-2d3d-4a3e-96a1-f96f50fdbef8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.400724 Sep 06 16:15:17.634718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 54/128] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:17 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:17.638037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:17.640134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:17.641925 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:17.645525 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:17.656287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.658194 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.659191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:17.661532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.664247 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.665068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.665360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.665762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:17.666529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:17.667041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:17.667324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:17.667494 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:18.001238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:18.022499 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5027d051-4ced-49a4-9ea9-abd71d705d89 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.415658 Sep 06 16:15:18.023477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 75/129] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:17 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:18.155455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:18.177361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0ab360fa-5ccb-4333-8a9c-de48c2fe19d1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.540734 Sep 06 16:15:18.192075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 55/130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:17 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:18.405196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-54aea466-f4ba-4e92-befd-6234b18ce381 req-faebe097-42ec-454b-9416-bfe06a309acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec48627-7548-4e6c-87fd-4a024c9a5f40", "name": "network-vif-plugged", "status": "completed", "tag": "6439cdc1-f69f-4086-af0b-645e3e86f015"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:18.422144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-54aea466-f4ba-4e92-befd-6234b18ce381 req-faebe097-42ec-454b-9416-bfe06a309acc service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:18.422998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-54aea466-f4ba-4e92-befd-6234b18ce381 req-faebe097-42ec-454b-9416-bfe06a309acc service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:18.425309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-54aea466-f4ba-4e92-befd-6234b18ce381 req-faebe097-42ec-454b-9416-bfe06a309acc service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:18.448602 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-54aea466-f4ba-4e92-befd-6234b18ce381 req-faebe097-42ec-454b-9416-bfe06a309acc service nova] Creating event network-vif-plugged:6439cdc1-f69f-4086-af0b-645e3e86f015 for instance eec48627-7548-4e6c-87fd-4a024c9a5f40 on hv-cinder-85220 Sep 06 16:15:18.455942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-54aea466-f4ba-4e92-befd-6234b18ce381 req-faebe097-42ec-454b-9416-bfe06a309acc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053652 Sep 06 16:15:18.457255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 76/131] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:18.638297 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:18.639049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:18.646026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:18.646535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:18.647028 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:18.647762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:18.648224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:18.648662 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:18.673233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:18.675723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:18.686735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:18.687922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:18.688987 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:18.690367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:18.691553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:18.692379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:18.737215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:18.745345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8e3fba9e-bde3-4418-ad20-9fa34140726b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1218 microversion: 2.1 time: 0.110996 Sep 06 16:15:18.745933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 56/132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:18 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:18.880030 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:18.889978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1492475c-3856-47b3-9cb9-c25d45d2d2a4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.226444 Sep 06 16:15:18.890871 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 77/133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:18 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:19.053348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:19.054645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:19.066308 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.067201 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.068043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:19.069854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.070671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.071481 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:19.220855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:19.222389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:19.232692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.234112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.235210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:19.237303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.238314 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.239306 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:19.258026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:19.276136 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-62fdd15a-73d8-4fd9-bb7e-5b6e988482ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.230256 Sep 06 16:15:19.277239 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 57/134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:19 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:19.531015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:19.555236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dcb69567-5388-4764-ad2b-bb385bea471d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.340804 Sep 06 16:15:19.570698 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 78/135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:19 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:19.771489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:19.773516 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:19.782517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.783651 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.784397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:19.785603 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.787712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.788710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:19.918441 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:19.925953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:19.932022 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:19.947506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.952165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2cfaea07-021f-4206-b1ca-45b06369a87b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1218 microversion: 2.1 time: 0.185107 Sep 06 16:15:19.953316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.954018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 58/136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:19 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:19.955602 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:19.960298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:19.961220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:19.961997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:20.329540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:20.330928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:20.343179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:20.349495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:20.351764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:20.356126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:20.358474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:20.361284 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:20.552885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:20.578832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2e8da476-53fc-4e70-834b-470a670f69a0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.666454 Sep 06 16:15:20.582711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 79/137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:19 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:20.606901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:20.609234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:20.630925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:20.631802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:20.632419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:20.633285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:20.635416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:20.637374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:21.245193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:21.256712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1151945d-db72-4889-bdd2-61205dd5ff16 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.946403 Sep 06 16:15:21.258163 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 59/138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:20 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:21.275474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:21.276479 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:21.288165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:21.292177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:21.292885 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:21.294708 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:21.297804 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:21.302601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:21.613351 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:21.653580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-96d44c6e-85b5-411f-b160-3aec21328b98 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 1.055634 Sep 06 16:15:21.655114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 80/139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:20 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:21.678265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:21.682231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:21.698809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:21.700255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:21.701292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:21.703447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:21.704582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:21.705959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:21.742965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:21.771998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e6c2b7d9-9bba-4065-8fff-126059ce3b13 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.510794 Sep 06 16:15:21.774758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 60/140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:21 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:22.066515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:22.081593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7e6a9a92-a34c-4971-8e11-ddcb313067c3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.423587 Sep 06 16:15:22.082526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 81/141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:21 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:22.305378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:22.306766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:22.318798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=68 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:22.321617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:22.322606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:22.323330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:22.324304 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:22.324985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:22.326538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:22.604177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:22.616519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9822d63d-fbf2-4ce8-87d4-744fddbd77ec tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.316624 Sep 06 16:15:22.617715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 61/142] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:22 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:22.701571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:22.703213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:22.706136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:22.718108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:22.719135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:22.719757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:22.722322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:22.723076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:22.723899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:22.737243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:22.803232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:22.803864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:22.810854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:22.811452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:22.811966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:22.813032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:22.813558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:22.814994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:22.834941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:22.915587 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:22.931509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a7291cbb-08a0-4c70-bf43-d2e060083580 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.133785 Sep 06 16:15:22.933120 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 62/143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:22 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:23.013570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:23.030182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6150867b-4538-4de2-93fa-33f17503809f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.333533 Sep 06 16:15:23.031580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 82/144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:22 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:23.125545 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:23.126186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:23.133726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:23.134230 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:23.134683 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:23.135421 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:23.135874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:23.136313 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:23.289571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:23.300621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ec8bc730-0a09-4f9e-85a9-8352267ceda1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.178989 Sep 06 16:15:23.301404 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 63/145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:23 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:23.641859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:23.642849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:23.650414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:23.651024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:23.651647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:23.652601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:23.653288 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:23.653901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:23.820347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:23.831849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6390d925-bab1-4c9e-8bb2-afa379ba1721 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.193343 Sep 06 16:15:23.847103 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 83/146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:23 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:23.978439 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:23.979111 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:23.985654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:23.986753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:23.987199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:23.988006 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:23.988463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:23.988972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:24.059125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:24.059755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:24.076898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:24.077406 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:24.077894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:24.082982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:24.083829 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:24.085754 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:24.111653 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:24.121433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b6337871-cbd6-4657-81fb-5e139a62b397 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.148141 Sep 06 16:15:24.131431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 64/147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:23 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:24.282504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:24.292953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e7f8cf3d-ec14-4fe9-b925-b42d66d682d2 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.239511 Sep 06 16:15:24.304074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 84/148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:24 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:24.327133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:24.328656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:24.336011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:24.336563 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:24.336953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:24.337946 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:24.338612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:24.339084 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:24.518238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:24.532541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0fe7d8d1-078a-4c22-b34b-8bd42232b275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.209328 Sep 06 16:15:24.534104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 65/149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:24 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:24.859722 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:24.860908 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:24.869860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:24.870346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:24.870809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:24.871543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:24.871995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:24.872415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.026481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:25.036099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c1f3612b-8c4e-454d-b735-4c70530524cf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.183690 Sep 06 16:15:25.037030 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 85/150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:24 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:25.147291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:25.149168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:25.161450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:25.162333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:25.163070 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.164279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:25.165260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:25.166231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.281061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:25.293127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fdf9af5b-e39c-459c-ab67-064ed5ee7ae5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.151401 Sep 06 16:15:25.294018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 66/151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:25 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:25.337185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:25.338107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:25.345244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:25.346194 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:25.346899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.347897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:25.348514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:25.348988 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.529171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-e80f4e38-bbcc-44ea-a4e1-7e10e371e545 req-67c4a29b-6a63-4dde-a4e6-ecf176fa960d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbd0bbd-012b-4497-a8e2-247e7cfd22cd", "name": "network-vif-plugged", "status": "completed", "tag": "238bad90-5526-4449-82a2-c985d1021f8a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:25.552946 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e80f4e38-bbcc-44ea-a4e1-7e10e371e545 req-67c4a29b-6a63-4dde-a4e6-ecf176fa960d service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:25.553871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e80f4e38-bbcc-44ea-a4e1-7e10e371e545 req-67c4a29b-6a63-4dde-a4e6-ecf176fa960d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:25.554456 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e80f4e38-bbcc-44ea-a4e1-7e10e371e545 req-67c4a29b-6a63-4dde-a4e6-ecf176fa960d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.578907 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-e80f4e38-bbcc-44ea-a4e1-7e10e371e545 req-67c4a29b-6a63-4dde-a4e6-ecf176fa960d service nova] Creating event network-vif-plugged:238bad90-5526-4449-82a2-c985d1021f8a for instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd on hv-cinder-85220 Sep 06 16:15:25.590580 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-e80f4e38-bbcc-44ea-a4e1-7e10e371e545 req-67c4a29b-6a63-4dde-a4e6-ecf176fa960d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064793 Sep 06 16:15:25.592654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 67/152] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:25.603099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:25.604701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:25.620311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:25.621418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:25.622318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.623763 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:25.624824 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:25.626345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:25.630020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:25.644820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f7ecc34-eeed-484d-9aeb-75d2e27abb8f tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.312084 Sep 06 16:15:25.646136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 86/153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:25 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:25.844221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:25.856644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4b668615-305d-48ca-8d61-747004063b3e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.261131 Sep 06 16:15:25.857532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 68/154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:25 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:26.060745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:26.061618 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:26.069855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.070545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.071157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:26.072034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.072683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.073172 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:26.270652 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:26.284299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-121ecd70-3688-42ba-84a3-e5b845186731 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.227281 Sep 06 16:15:26.286112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 87/155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:26 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:26.325643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:26.327011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:26.334788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.335518 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.335944 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:26.337891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.337891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.337891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:26.409179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:26.422526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-519d0a99-bfc4-42d3-9a1d-840b41b3dc71 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.100386 Sep 06 16:15:26.424135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 69/156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:26 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:26.687803 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:26.688422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:26.695631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.696040 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.697159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:26.697159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.697623 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.698045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:26.855488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:26.868481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3562811a-59f3-4914-bcfe-e43c3c3b7a3c tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1315 microversion: 2.1 time: 0.185275 Sep 06 16:15:26.869363 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 88/157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:26 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:26.885061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:26.886074 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:26.896889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.897814 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.898556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:26.899836 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:26.900692 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:26.901411 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:27.144336 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:27.160687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e66ee768-5cc5-417f-a6cb-d0d5672b2204 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.281162 Sep 06 16:15:27.161850 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 70/158] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:26 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:27.310773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:27.312090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:27.317088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:27.323016 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:27.323517 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:27.324063 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:27.324807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:27.325266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:27.325689 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:27.447280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:27.448312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:27.455979 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:27.456842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:27.457493 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:27.458846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:27.459831 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:27.460362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:27.565102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:27.574431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eca5f27d-e006-4f36-863d-ec2d04eb500d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.131111 Sep 06 16:15:27.575644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 71/159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:27 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:27.597445 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=8 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:27.619373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:27.645241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e9ebe4bb-4841-4695-834d-4e65eec3a493 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.339251 Sep 06 16:15:27.646337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 89/160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:27 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:27.912179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:27.913255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:27.924340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:27.925306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:27.926560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:27.928102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:27.929227 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:27.930010 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:28.156090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:28.172775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f6a17d03-b38b-4b6b-b022-9ea4c03bb551 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1503 microversion: 2.1 time: 0.268275 Sep 06 16:15:28.175018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 72/161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:27 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:28.195526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:28.198452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:28.212282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:28.213157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:28.214048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:28.216323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:28.218417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:28.219853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:28.420985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:28.429472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a2a8422e-38ba-45d3-a18a-0ac65e8bd133 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.247178 Sep 06 16:15:28.430140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 90/162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:28 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:28.608058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:28.609760 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:28.618260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:28.619196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:28.619855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:28.620777 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:28.621549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:28.622163 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:28.698492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:28.703352 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:28.703974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:28.714702 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1885046b-e5d0-45b0-873e-eb749288398c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.113884 Sep 06 16:15:28.715383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 73/163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:28 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:28.733410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:28.736261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:28.739422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:28.741180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:28.742649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:28.743924 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:28.987705 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:28.997760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-28540d42-c625-4ed1-a320-e9da48601df5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.317577 Sep 06 16:15:28.999110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 91/164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:28 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:29.476528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:29.477675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:29.506539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:29.508168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:29.509107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:29.510684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:29.511677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:29.512491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:29.756197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:29.766849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9b5ce07e-f33c-4ec5-ac07-1bce505ff991 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.299859 Sep 06 16:15:29.769353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 74/165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:29 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:29.775802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:29.778502 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:29.789904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:29.790749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:29.791343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:29.792274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:29.793045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:29.793771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:29.880515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:29.889514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-676af1a0-3010-46e8-9519-9467934c9541 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1266 microversion: 2.1 time: 0.130820 Sep 06 16:15:29.890587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 92/166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:29 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:29.957266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42077c04-b0ac-4d10-a6de-511a556dfbf9"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:29.960873 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:29.971974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:29.972465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:29.972897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:29.973606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:29.974066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:29.974490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:30.025653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:30.026368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:30.039589 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:30.045709 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:30.047894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:30.056877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:30.058051 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:30.061484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:30.395280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:30.418505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9952b0b1-56d8-4bee-9257-ce11eb3c1c71 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.398449 Sep 06 16:15:30.419595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 93/167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:30 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:30.811268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:30.812112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:30.823383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:30.823980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:30.825202 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:30.826243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:30.828831 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:30.830410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:31.075567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:31.086266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-61b5a2f3-f58b-4e16-896c-0bf8ae087021 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.279713 Sep 06 16:15:31.087261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 94/168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:30 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:31.092516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:31.093625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:31.101757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:31.102485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:31.103371 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:31.104324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:31.104871 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:31.105468 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:31.316981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:31.328961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bfa26d77-8379-4b8c-9aef-121ef02d6316 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1274 microversion: 2.1 time: 0.240250 Sep 06 16:15:31.333058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 95/169] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:31 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:31.450948 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:31.451993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:31.465830 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:31.472736 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:31.475793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:31.477640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:31.481961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:31.484210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:31.924294 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c8079f4a-c952-460c-9610-cdca6b55adb3 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "POST /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.970766 Sep 06 16:15:31.931285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 75/170] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:15:29 2022] POST /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40/os-volume_attachments => generated 194 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:15:32.139452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:32.140715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:32.190487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:32.193650 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:32.196082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:32.196866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:32.197492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:32.197935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:32.257922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:32.271085 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6de76a69-fac6-4e33-8f25-137fd85326d6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.824715 Sep 06 16:15:32.282689 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 96/171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:31 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:32.373289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:32.374948 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:32.384191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:32.390495 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:32.393382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:32.395632 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:32.396838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:32.397819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:32.645236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:32.693043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-67060706-664e-48b6-8a3f-2e377ab3ffaf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1272 microversion: 2.1 time: 0.319147 Sep 06 16:15:32.694645 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 97/172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:32 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:32.720114 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:32.741208 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-adc465d1-7d13-4081-9b95-d850d5263cb7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.613545 Sep 06 16:15:32.741874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 76/173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:32 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:33.303576 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:33.305398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:33.315245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:33.317430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:33.320354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:33.322007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:33.322859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:33.323744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:33.701318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:33.706329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:33.717276 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9580f184-8c96-4e7f-b382-0491ddc5a182 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1322 microversion: 2.1 time: 0.420200 Sep 06 16:15:33.718118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 98/174] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:33 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:33.744732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:33.755083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:33.781367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:33.784124 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:33.784745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:33.785552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:33.788737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:33.796469 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:33.807507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:33.814403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:33.833852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:33.837330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:33.838114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:33.842916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:33.846196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:33.848555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:34.506318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:34.518385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d708fdbd-a80d-4f41-88ba-39ce0931300c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.781087 Sep 06 16:15:34.525358 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 77/175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:33 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:34.531174 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-3b4acd6c-ab04-4cd3-aba8-ffc5bc6c8f17 req-0497670b-5c0b-4ed2-9e21-ee67b707b876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75eba83a-9a4e-46fb-854b-17e2f53a0444", "name": "network-vif-plugged", "status": "completed", "tag": "287e2c73-e48f-47ca-97ed-0553597da139"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:34.555942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3b4acd6c-ab04-4cd3-aba8-ffc5bc6c8f17 req-0497670b-5c0b-4ed2-9e21-ee67b707b876 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:34.556640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3b4acd6c-ab04-4cd3-aba8-ffc5bc6c8f17 req-0497670b-5c0b-4ed2-9e21-ee67b707b876 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:34.557231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3b4acd6c-ab04-4cd3-aba8-ffc5bc6c8f17 req-0497670b-5c0b-4ed2-9e21-ee67b707b876 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:34.582630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:34.588901 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-3b4acd6c-ab04-4cd3-aba8-ffc5bc6c8f17 req-0497670b-5c0b-4ed2-9e21-ee67b707b876 service nova] Creating event network-vif-plugged:287e2c73-e48f-47ca-97ed-0553597da139 for instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 on hv-cinder-85220 Sep 06 16:15:34.602133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-3b4acd6c-ab04-4cd3-aba8-ffc5bc6c8f17 req-0497670b-5c0b-4ed2-9e21-ee67b707b876 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074904 Sep 06 16:15:34.603431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 78/176] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:34.621023 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ec43c384-1d00-48f2-8551-ba42cbe74275 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.844499 Sep 06 16:15:34.636199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 99/177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:33 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:34.748530 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:34.749876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:34.769368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:34.770021 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:34.770876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:34.771980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:34.772664 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:34.773535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:34.808375 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:35.345732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:35.378077 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c27c05ee-ba94-40ad-a5cb-38163520555a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1514 microversion: 2.1 time: 0.634886 Sep 06 16:15:35.379706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 79/178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:34 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1514 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:35.411917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:35.417062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:35.431410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:35.432611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:35.433872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:35.435424 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:35.437219 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:35.440045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:35.575856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:35.577381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:35.590313 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:35.591293 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:35.592921 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:35.594129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:35.595784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lazy-loading 'flavor' on Instance uuid 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:15:35.596484 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:35.597386 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:35.843466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9aa15896-dfde-45c7-886f-769262fed259 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd/action" status: 200 len: 32 microversion: 2.1 time: 0.443207 Sep 06 16:15:35.844679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 100/179] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:15:35 2022] POST /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:15:35.862607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:35.863807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:35.904388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:35.907192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:35.908268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:35.911215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:35.911691 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:35.912125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:35.973594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:35.984380 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3e66fdfc-a488-4a80-bc0d-6620b5c3e557 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.420101 Sep 06 16:15:35.985211 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 80/180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:35 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:35.992743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:35.993610 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:36.000435 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:36.000958 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:36.001458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:36.002216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:36.002713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:36.003145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:36.244183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:36.264568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-72d69fdf-1616-4edd-bfdf-54cfe3bd175d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1367 microversion: 2.1 time: 0.417651 Sep 06 16:15:36.266124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 101/181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:35 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:36.273826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b583a7e3-766b-48e7-b945-c027cb1f692d req-eb12cc95-52d0-4404-b31c-8e2c5118dfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8113b2f3-9edb-4717-b0b4-22bfe5b5e225", "tag": "f80d0f7c-52b4-4edc-a756-ffda4f7feceb"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:36.288509 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b583a7e3-766b-48e7-b945-c027cb1f692d req-eb12cc95-52d0-4404-b31c-8e2c5118dfe2 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:36.290567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b583a7e3-766b-48e7-b945-c027cb1f692d req-eb12cc95-52d0-4404-b31c-8e2c5118dfe2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:36.291426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b583a7e3-766b-48e7-b945-c027cb1f692d req-eb12cc95-52d0-4404-b31c-8e2c5118dfe2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:36.306005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b583a7e3-766b-48e7-b945-c027cb1f692d req-eb12cc95-52d0-4404-b31c-8e2c5118dfe2 service nova] Creating event network-changed:f80d0f7c-52b4-4edc-a756-ffda4f7feceb for instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 on hv-cinder-85220 Sep 06 16:15:36.313495 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b583a7e3-766b-48e7-b945-c027cb1f692d req-eb12cc95-52d0-4404-b31c-8e2c5118dfe2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044278 Sep 06 16:15:36.315374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 102/182] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:36.401085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:36.418270 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-512baacb-e808-4f60-86b0-309767bada11 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.430227 Sep 06 16:15:36.419618 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 81/183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:35 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:37.012081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:37.013889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:37.022605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:37.023426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:37.023894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:37.024767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:37.025414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:37.025994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:37.242318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:37.252862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2146f588-47f3-4d25-a019-345530afff5d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.247411 Sep 06 16:15:37.268134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 103/184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:37 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:37.295502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:37.296658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:37.309645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:37.310974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:37.311709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:37.313417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:37.314589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:37.315398 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:37.461181 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:37.482482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:37.568377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:37.573489 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:37.575289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:37.581895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:37.583633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:37.588666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:38.006432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:38.032215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ab96863b-9e6d-4c41-bfeb-d47cc9c9d9e4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1556 microversion: 2.1 time: 0.744956 Sep 06 16:15:38.034196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 82/185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:37 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1556 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:38.115464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:38.118584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:38.120534 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:38.143895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:38.143895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:38.143895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:38.143895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:38.144237 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:38.144237 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:38.147543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-baeb5af4-ca9a-40cd-a070-1904ea3f2a31 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.706330 Sep 06 16:15:38.148401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 104/186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:37 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:38.282016 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:38.285406 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:38.318571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:38.323261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:38.325160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:38.328837 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:38.329862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:38.332531 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:38.386503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1d5acade-3a82-4e6a-b23c-bbcafa298951 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.300630 Sep 06 16:15:38.387616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 83/187] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:15:38 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:39.199934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:39.201036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:39.226742 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:39.229806 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:39.236355 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:39.237606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:39.239521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:39.240481 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:39.723065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:39.746180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-adf641a4-86dd-40c0-af71-f67ca4719ae1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.559218 Sep 06 16:15:39.756013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 84/188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:39 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:39.946877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:39.956194 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e47f25ed-2b2d-4cd6-9cbe-9ac30b97d204 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 1.681913 Sep 06 16:15:39.957158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 105/189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:38 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:40.785937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:40.786737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:40.799259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:40.799929 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:40.800699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:40.801462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:40.801952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:40.816406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:40.981363 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:40.982596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:40.992256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:40.996160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:40.996980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:40.999450 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:41.000166 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:41.001344 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:41.176963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:41.200023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5488fb1b-5499-441d-bf1f-0d1d9755940b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.418328 Sep 06 16:15:41.219478 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 85/190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:40 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:41.412671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:41.421711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a627e224-bd7e-4542-905b-53e8e3c99c40 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.444360 Sep 06 16:15:41.425342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 106/191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:40 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:41.853307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-054b77e3-f79f-4c06-9cfc-b17979090227 req-77bfaac2-0b9a-4191-8e9d-05cceac8bc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75eba83a-9a4e-46fb-854b-17e2f53a0444", "tag": "287e2c73-e48f-47ca-97ed-0553597da139"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:41.884431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-054b77e3-f79f-4c06-9cfc-b17979090227 req-77bfaac2-0b9a-4191-8e9d-05cceac8bc31 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:41.884918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-054b77e3-f79f-4c06-9cfc-b17979090227 req-77bfaac2-0b9a-4191-8e9d-05cceac8bc31 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:41.885559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-054b77e3-f79f-4c06-9cfc-b17979090227 req-77bfaac2-0b9a-4191-8e9d-05cceac8bc31 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:41.912735 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-054b77e3-f79f-4c06-9cfc-b17979090227 req-77bfaac2-0b9a-4191-8e9d-05cceac8bc31 service nova] Creating event network-changed:287e2c73-e48f-47ca-97ed-0553597da139 for instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 on hv-cinder-85220 Sep 06 16:15:41.927787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-054b77e3-f79f-4c06-9cfc-b17979090227 req-77bfaac2-0b9a-4191-8e9d-05cceac8bc31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078108 Sep 06 16:15:41.929016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 86/192] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:15:42.250447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:42.252535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:42.271526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:42.273346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:42.276866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:42.278012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:42.278697 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:42.280125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:42.465991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:42.466724 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:42.499790 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:42.505923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:42.510987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:42.514996 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:42.520043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:42.522228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:42.748315 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:42.770272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-df22f2fb-0fbc-4cab-a957-0408ff3c2435 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.529061 Sep 06 16:15:42.772140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 107/193] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:42 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:42.987167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:43.026711 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bd732508-d435-4907-8f7c-61a4c86a5bc1 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.564486 Sep 06 16:15:43.028171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 87/194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:42 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:43.803459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:43.804577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:43.814619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:43.818779 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:43.821009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:43.822222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:43.823159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:43.823838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:44.081775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:44.083184 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:44.108781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:44.112370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:44.118428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:44.126533 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:44.130211 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:44.130914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:44.182507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:44.198988 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ecbe934-8570-4f18-a6f8-9e047d02698b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.401253 Sep 06 16:15:44.199748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 108/195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:43 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:44.669134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-54b86a5d-4454-4c70-95db-386f70ad527d req-87d06a17-666f-46be-af89-4f0c3ca973e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8113b2f3-9edb-4717-b0b4-22bfe5b5e225", "name": "network-vif-plugged", "status": "completed", "tag": "f80d0f7c-52b4-4edc-a756-ffda4f7feceb"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:44.711020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-54b86a5d-4454-4c70-95db-386f70ad527d req-87d06a17-666f-46be-af89-4f0c3ca973e3 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:44.711975 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-54b86a5d-4454-4c70-95db-386f70ad527d req-87d06a17-666f-46be-af89-4f0c3ca973e3 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:44.712789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-54b86a5d-4454-4c70-95db-386f70ad527d req-87d06a17-666f-46be-af89-4f0c3ca973e3 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:44.809689 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-54b86a5d-4454-4c70-95db-386f70ad527d req-87d06a17-666f-46be-af89-4f0c3ca973e3 service nova] Creating event network-vif-plugged:f80d0f7c-52b4-4edc-a756-ffda4f7feceb for instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 on hv-cinder-85220 Sep 06 16:15:44.828640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-54b86a5d-4454-4c70-95db-386f70ad527d req-87d06a17-666f-46be-af89-4f0c3ca973e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162725 Sep 06 16:15:44.830936 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 109/196] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:15:45.144619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:45.213856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-04bd2748-81cb-4355-8545-8ce06c7fbd87 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 1.132232 Sep 06 16:15:45.228085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 88/197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:44 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:45.246749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:45.248126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:45.261999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:45.263297 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:45.267724 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:45.274934 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:45.286709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:45.289142 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:45.290424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:45.291542 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:45.315793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:45.316654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:45.317475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:45.327187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:45.328248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:45.329007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:45.418354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:15:45.712844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1197d816-9d87-4d98-83b8-b6c126971b22 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 204 len: 0 microversion: 2.1 time: 0.472999 Sep 06 16:15:45.713941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 89/198] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:15:45 2022] DELETE /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:15:45.727558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:45.732497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:45.742852 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:45.749847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:45.750919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:45.753119 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:45.753769 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:45.754445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:45.878702 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:45.897895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6f02fe98-067e-4948-a290-235e844517fa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.655394 Sep 06 16:15:45.898921 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 110/199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:45 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:46.038614 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:46.048409 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8e0a037f-fa69-42a4-96df-f545dd3a5024 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.327718 Sep 06 16:15:46.064548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 90/200] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:45 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:46.260048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:46.261236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:46.269954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:46.270452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:46.270915 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:46.272254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:46.272725 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:46.273153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:46.457116 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:46.473300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-efe2a1bd-f306-4713-96c6-121a128d12ff tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.220146 Sep 06 16:15:46.474652 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 111/201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:46 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:46.925434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:46.926323 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:46.932839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:46.933346 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:46.933762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:46.934466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:46.935434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:46.936036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:47.074959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:47.076343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:47.083933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:47.084597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:47.085134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:47.086583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:47.087252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:47.087921 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:47.107708 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:47.130192 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-80e0a40b-f351-4e02-b456-0898c8878dc8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.208160 Sep 06 16:15:47.131548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 91/202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:46 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:47.276535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:47.301137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f001ea5-e9c7-44d3-8166-6383e7b39880 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.228721 Sep 06 16:15:47.303578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 112/203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:47 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:47.521210 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:47.522278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:47.548800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:47.549521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:47.550104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:47.551001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:47.551811 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:47.552379 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:47.770175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:47.784564 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-41a50d17-afe8-421a-8ae9-43fef8dc5ac7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.269576 Sep 06 16:15:47.785377 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 92/204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:47 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:48.156955 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:48.158397 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:48.165314 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:48.165945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:48.166497 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:48.167506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:48.168007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:48.168526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:48.333191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:48.334245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:48.347939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:48.348769 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:48.349490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:48.351196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:48.355285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:48.356273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:48.555425 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:48.565339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-018e0125-5c5f-4828-8d27-357b85cb13a1 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.239764 Sep 06 16:15:48.565938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 93/205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:48 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:48.608057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:48.617734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d6e6eadd-c565-47df-84b9-26ab21b76a19 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.464787 Sep 06 16:15:48.618356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 113/206] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:48 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:48.812783 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:48.814091 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:48.820721 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:48.821217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:48.821657 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:48.822368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:48.822862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:48.823287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:48.989235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:48.998438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-67b74d66-344b-4a87-8fce-3e9cbfcf0527 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.190084 Sep 06 16:15:48.999065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 94/207] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:48 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:49.590654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:49.591316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:49.599313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:49.599841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:49.600340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:49.601090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:49.601537 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:49.601974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:49.641917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:49.643207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:49.651626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:49.652623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:49.653440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:49.654777 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:49.655678 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:49.656510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:49.665811 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:49.753070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:49.759503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:49.770559 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0b52a3ee-03a6-462c-aa6f-1119f4686f93 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.183689 Sep 06 16:15:49.771773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 114/208] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:49 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:49.851386 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:49.860088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8ceb42d1-16ea-427d-a8c6-5d8170d85cde tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.222057 Sep 06 16:15:49.860910 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 95/209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:49 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:50.037793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:50.038735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:50.049876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:50.049876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:50.049876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:50.050452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:50.050738 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:50.051222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:50.245090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:50.255055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-928612c6-1fc2-4c2c-84e0-043796d7db64 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.221410 Sep 06 16:15:50.255676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 115/210] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:50 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:50.805033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:50.805602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:50.812584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:50.813324 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:50.813820 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:50.814479 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:50.815750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:50.815750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:50.887292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:50.889130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:50.896278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:50.896774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:50.897317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:50.898295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:50.898851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:50.899591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:50.981057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:50.991073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4325e54d-bffd-465f-822f-1a4572105404 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.189974 Sep 06 16:15:50.998728 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 96/211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:50 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:51.063826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:51.072993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0716803a-2dc1-4dac-a619-038f29b8d11f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.190587 Sep 06 16:15:51.073918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 116/212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:50 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:51.279079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:51.280004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:51.287656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:51.288290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:51.289040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:51.289844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:51.290425 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:51.298092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:51.482044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:51.497130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9aea0892-580e-432e-b2a8-cce136c8d0ba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.222660 Sep 06 16:15:51.498242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 97/213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:51 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:52.016096 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:52.016964 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:52.025621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:52.026146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:52.026889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:52.027876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:52.028384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:52.029022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:52.098459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:52.099252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:52.106809 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:52.107311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:52.107756 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:52.108520 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:52.109074 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:52.109672 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:52.234256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:52.243373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0cb1633a-6780-4515-9be3-63e259981e25 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.231875 Sep 06 16:15:52.263006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 117/214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:52 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:52.291036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:52.305064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-57b7c354-e64e-48d3-a52c-094820103196 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.211777 Sep 06 16:15:52.305811 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 98/215] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:52 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:52.524784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:52.525558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:52.535235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:52.535735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:52.536171 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:52.536879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:52.537484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:52.538068 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:52.788666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:52.797772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0366f584-2e09-49f9-908c-f0644ed0d46e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.278277 Sep 06 16:15:52.799266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 118/216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:52 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:53.268413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:53.269047 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:53.271435 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:53.276607 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:53.277093 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:53.277536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:53.278249 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:53.278729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:53.279170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:53.333776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:53.334757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:53.337169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=74 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:15:53.343641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:53.344164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:53.344609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:53.345814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:53.346350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:53.346810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:53.538085 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:53.552563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-39713f87-5f80-4d19-8b32-fd59e7f2de8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.225583 Sep 06 16:15:53.553676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 119/217] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:53 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:53.607630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:53.624768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8230191d-dda6-4dc8-bc72-c2968265544d tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.358953 Sep 06 16:15:53.640589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 99/218] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:53 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:53.824347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:53.825158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:53.834597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:53.846415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:53.848821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:53.850101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:53.850763 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:53.852183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:54.048858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:54.062402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3c5cf692-a631-4790-a96c-0f28956c453a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1314 microversion: 2.1 time: 0.241854 Sep 06 16:15:54.063455 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 120/219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:53 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:54.579643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:54.580420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:54.588160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:54.588684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:54.589125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:54.589829 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:54.590283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:54.590738 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:54.665319 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:54.665988 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:54.673551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:54.674683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:54.675395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:54.676476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:54.677315 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:54.677966 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:54.853710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:54.867514 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ccd8e6a6-df05-4939-867a-6b03721bf422 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.291754 Sep 06 16:15:54.868739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 100/220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:54 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:54.974550 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:54.988136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4f3f7798-ad4a-478b-89a7-38de0c29ba42 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1555 microversion: 2.1 time: 0.326879 Sep 06 16:15:54.989726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 121/221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:54 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1555 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:55.088334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:55.088951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:55.096601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:55.097211 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:55.097649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:55.099199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:55.099649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:55.100261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:55.328216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:55.337257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-15ce3845-1776-4b8e-8539-8d8d1ad77067 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1497 microversion: 2.1 time: 0.254258 Sep 06 16:15:55.337906 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 101/222] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:55 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1497 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:55.583809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-82652140-32a0-411a-bc26-cf3f33ff18e5 req-83995597-ddfb-4cc8-b1c3-96fa6ebc8cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec48627-7548-4e6c-87fd-4a024c9a5f40", "name": "network-vif-deleted", "tag": "6439cdc1-f69f-4086-af0b-645e3e86f015"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:15:55.602461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82652140-32a0-411a-bc26-cf3f33ff18e5 req-83995597-ddfb-4cc8-b1c3-96fa6ebc8cca service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:55.603343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82652140-32a0-411a-bc26-cf3f33ff18e5 req-83995597-ddfb-4cc8-b1c3-96fa6ebc8cca service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:55.603909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82652140-32a0-411a-bc26-cf3f33ff18e5 req-83995597-ddfb-4cc8-b1c3-96fa6ebc8cca service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:55.621169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-82652140-32a0-411a-bc26-cf3f33ff18e5 req-83995597-ddfb-4cc8-b1c3-96fa6ebc8cca service nova] Creating event network-vif-deleted:6439cdc1-f69f-4086-af0b-645e3e86f015 for instance eec48627-7548-4e6c-87fd-4a024c9a5f40 on hv-cinder-85220 Sep 06 16:15:55.626824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-82652140-32a0-411a-bc26-cf3f33ff18e5 req-83995597-ddfb-4cc8-b1c3-96fa6ebc8cca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047237 Sep 06 16:15:55.627386 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 122/223] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:15:55.898305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:55.899048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:55.907114 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:55.908598 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:55.909245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:55.910188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:55.910995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:55.911637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:56.021742 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:56.023056 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:56.037288 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:56.038348 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:56.038924 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:56.040250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:56.040900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:56.041876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:56.078058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:56.087206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f2081bf4-c973-471e-b5ef-bb6312d734ca tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.193185 Sep 06 16:15:56.087990 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 102/224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:55 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:56.121560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:56.130565 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b5fcf732-0c35-40e8-8897-c4803f7eeaaf tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1513 microversion: 2.1 time: 0.118305 Sep 06 16:15:56.142728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 123/225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:56 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1513 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:57.110881 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:57.111505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:57.118102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:57.118582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:57.119064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:57.119768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:57.120223 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:57.120640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:57.156888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:57.158734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:57.166498 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:57.167031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:57.167464 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:57.168238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:57.168849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:57.169485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:57.243547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:57.253104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8277f669-bcff-495a-92de-9673ca666df5 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1513 microversion: 2.1 time: 0.102533 Sep 06 16:15:57.253758 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 124/226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:57 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:57.332884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:57.347945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aa652b20-7f49-44ad-ac01-f9cb95661750 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.240862 Sep 06 16:15:57.348794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 103/227] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:57 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:58.283359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:58.284067 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:58.290381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:58.290904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:58.291342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:58.292109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:58.292554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:58.292971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:58.373395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:58.381576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:58.382275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:58.383646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fda2625c-f4bf-4970-9e1d-563803812b03 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1513 microversion: 2.1 time: 0.105296 Sep 06 16:15:58.384409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 125/228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:58 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1513 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:58.389207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:58.389696 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:58.390134 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:58.390882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:58.391334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:58.392476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:58.548942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:58.563959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-daf6dee2-b410-450a-bc78-98aea09d1408 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.185172 Sep 06 16:15:58.565861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 104/229] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:58 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:15:59.411029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:59.411761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:59.420684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:59.421376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:59.422153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:59.424238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:59.424601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:59.425034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:59.497392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:59.508316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b6b4cca7-0f1a-4dd7-85d6-98cd45911cdb tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1346 microversion: 2.1 time: 0.103037 Sep 06 16:15:59.509591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 126/230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:59 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1346 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:59.592004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:59.593009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:59.603986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:59.604485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:59.605948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:59.606351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:59.607134 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:59.607835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:59.786034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:15:59.794370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8f971bf0-52ef-4354-ae8d-965a0a591765 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.208599 Sep 06 16:15:59.795073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 105/231] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:15:59 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:15:59.979799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:15:59.980852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:15:59.989191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:59.990129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:59.990958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:15:59.992113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:15:59.992768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:15:59.993373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:00.031633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:16:00.162217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a9b1a09a-4eb3-4157-82b0-220991ffa1b8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 204 len: 0 microversion: 2.1 time: 0.186932 Sep 06 16:16:00.165336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 127/232] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:15:59 2022] DELETE /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:16:00.179978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:00.181374 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:00.195719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:00.196562 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:00.197213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:00.198325 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:00.199264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:00.200248 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:00.412938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:00.422502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a976c018-1b96-417f-b06b-2f655eb5cd98 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.250850 Sep 06 16:16:00.424150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 106/233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:00 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:00.535860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:00.536616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:00.543333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:00.543826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:00.544261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:00.544974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:00.545434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:00.545860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:00.598181 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:00.599719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:00.600178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:00.601361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lazy-loading 'fault' on Instance uuid eec48627-7548-4e6c-87fd-4a024c9a5f40 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:00.659283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:00.668060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7a89c6c9-5db0-4b44-9ab7-32caec864940 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1351 microversion: 2.1 time: 0.137334 Sep 06 16:16:00.668655 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 128/234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:00 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:00.824063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:00.825094 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:00.833448 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:00.834076 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:00.834520 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:00.835326 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:00.836410 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:00.837225 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:01.006984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:01.015393 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-57286b2d-3b36-4be5-b446-a1bc10e4e07a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.195731 Sep 06 16:16:01.018613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 107/235] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:00 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:01.472540 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:01.473302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:01.486560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:01.487645 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:01.488484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:01.489449 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:01.490436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:01.491411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:01.699930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:01.703684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:01.709635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:01.726358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f0bc12e0-24d3-4fde-a373-2ff1e36588e0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.265396 Sep 06 16:16:01.727846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 129/236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:01 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:01.730858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:01.731418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:01.735133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:01.739859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:01.740838 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:01.741643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:01.791451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:01.791935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:01.792564 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:01.793039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lazy-loading 'fault' on Instance uuid eec48627-7548-4e6c-87fd-4a024c9a5f40 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:01.877008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:01.886625 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-209b9105-488a-4c38-b363-be18735a8f57 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1351 microversion: 2.1 time: 0.194228 Sep 06 16:16:01.887206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 108/237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:01 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:02.041368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:02.041982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:02.049155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:02.049654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:02.050092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:02.050949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:02.051292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:02.051728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:02.056430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:02.223095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:02.235156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fb023eb6-e808-402a-9f05-35373051251f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.197620 Sep 06 16:16:02.235819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 130/238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:02 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:02.754763 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:02.755396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:02.764654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:02.765474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:02.765920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:02.766829 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:02.767492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:02.767922 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:02.913919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:02.915262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:02.924322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:02.925152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:02.925746 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:02.926891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:02.927511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:02.928108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:02.969385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:02.982512 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:02.983707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:02.984542 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:02.986827 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lazy-loading 'fault' on Instance uuid eec48627-7548-4e6c-87fd-4a024c9a5f40 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:02.989302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4a7c8c05-ea31-405d-8521-f28a941c7625 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.238855 Sep 06 16:16:02.990731 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 109/239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:02 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:03.051109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:03.060799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ebc61506-6883-4476-a205-ea834b31440a tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1351 microversion: 2.1 time: 0.153742 Sep 06 16:16:03.061399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 131/240] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:02 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:03.258897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:03.259713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:03.266336 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:03.267579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:03.268354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:03.269136 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:03.269591 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:03.270026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:03.439137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:03.450531 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-12c5fa91-ecee-4643-abd4-4c974522b087 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.195601 Sep 06 16:16:03.457427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 110/241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:03 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:04.025958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:04.026968 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:04.038468 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.039071 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.039563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.040332 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.040845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.041333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.085303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:04.086839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:04.097887 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.098963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.099617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.100571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.101403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.102079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.121471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:04.144941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.145541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.146051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.146574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lazy-loading 'fault' on Instance uuid eec48627-7548-4e6c-87fd-4a024c9a5f40 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:04.196573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:04.209439 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-96529c27-2d3a-4aa8-b0df-af41d86a8a5e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1351 microversion: 2.1 time: 0.128349 Sep 06 16:16:04.209761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:04.210031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 111/242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:04 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:04.223910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-359f2680-3aca-4ec2-ba4b-0a7a48407fca tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.203065 Sep 06 16:16:04.225807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 132/243] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:04 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:04.474048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:04.474655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:04.481235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.481586 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.482040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.482901 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:04.483351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:04.483772 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:04.684731 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:04.691049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-98febf99-3f08-4508-b070-820391e98d6d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.221377 Sep 06 16:16:04.691640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 112/244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:04 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:05.237244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:05.237849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:05.244669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.245158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.245580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.246833 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.247443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.248017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.258246 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:05.259553 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:05.272715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.273585 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.275442 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.276910 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.277864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.278741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.290541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.291080 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.291517 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.291960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lazy-loading 'fault' on Instance uuid eec48627-7548-4e6c-87fd-4a024c9a5f40 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:05.344207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:05.353617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-83f26bb7-15a5-4f60-97c9-83ffe5c5b6d4 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1351 microversion: 2.1 time: 0.123410 Sep 06 16:16:05.354220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 133/245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:05 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:05.466212 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:05.475151 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-db558ab6-9c21-475f-a832-46106f83ba93 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.226274 Sep 06 16:16:05.475831 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 113/246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:05 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:05.717767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:05.718448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:05.725859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.726500 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.727027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.727862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:05.728469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:05.728973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:05.875732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:05.885119 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7e83d1e7-7086-49ee-8510-c63379c7ab98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.171355 Sep 06 16:16:05.885729 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 134/247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:05 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:06.389037 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:06.390077 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:06.399450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:06.399950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:06.400393 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:06.401117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:06.401575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:06.402001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:06.444799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:06.445294 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:06.445732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:06.446192 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lazy-loading 'fault' on Instance uuid eec48627-7548-4e6c-87fd-4a024c9a5f40 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:06.494390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '668452994ad942069d30f4bddbba15b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5974f0b22a7493da25b0b0aaa21c66b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:06.503659 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:06.504709 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:06.510064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-373b6738-12c4-44d8-bfec-de66efd15493 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 200 len: 1351 microversion: 2.1 time: 0.124901 Sep 06 16:16:06.511227 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 114/248] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:06 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:06.515202 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:06.516092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:06.516896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:06.518203 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:06.519157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:06.519939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:06.714137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:06.728317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-055eaaca-74d2-4a9d-9fbc-ae37dc2981ee tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.231306 Sep 06 16:16:06.729035 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 135/249] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:06 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:06.910046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:06.910701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:06.917424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:06.917926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:06.918361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:06.919123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:06.919578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:06.920101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.106304 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:07.121187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2d649f81-d0ad-471e-b4ae-89d97894f415 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.214694 Sep 06 16:16:07.122271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 115/250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:06 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:07.542651 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:07.543280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:07.550707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.551195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.551629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.552324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.552770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.553191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.568535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] HTTP exception thrown: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Request method failure captured: Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 HTTP/1.1 Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HgH0d3mUo12PV35ghNbA0wThM1unVH6SUHtgJtmIev9zjcUvqSfzVZDCxgCaKFzSk3wua6yVniBf_7GKBEIxE4b-A0oOrWYl-Q1VGQlQrnaKGWU1w31WTfQVOWrTEQFMJo0JmieQnhQuTJMWREuY7LUEMWGLEjk8Pbi-4ZLcaGgc4 Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:16:07.580009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 668452994ad942069d30f4bddbba15b4 Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.582297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'eec48627-7548-4e6c-87fd-4a024c9a5f40'} Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:16:07.583289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.584703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.586182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Returning 404 to user: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:16:07.586182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2a3b65f3-cb0d-4cb7-a80b-8a78b47fbca0 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 404 len: 111 microversion: 2.1 time: 0.042861 Sep 06 16:16:07.586182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 136/251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:07 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:16:07.711654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:07.714131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:07.721647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.722149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.722594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.723352 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.723811 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.724251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.739888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] HTTP exception thrown: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Request method failure captured: Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40/os-volume_attachments HTTP/1.1 Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HgH0d3mUo12PV35ghNbA0wThM1unVH6SUHtgJtmIev9zjcUvqSfzVZDCxgCaKFzSk3wua6yVniBf_7GKBEIxE4b-A0oOrWYl-Q1VGQlQrnaKGWU1w31WTfQVOWrTEQFMJo0JmieQnhQuTJMWREuY7LUEMWGLEjk8Pbi-4ZLcaGgc4 Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:16:07.744412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 668452994ad942069d30f4bddbba15b4 Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.747150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'server_id': 'eec48627-7548-4e6c-87fd-4a024c9a5f40'} Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:16:07.748761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:07.751175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:07.754472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Returning 404 to user: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:16:07.754472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d5545ef9-86f5-4b59-bcdb-7e2c4333e070 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038377 Sep 06 16:16:07.754472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 116/252] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:16:07 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:16:07.774884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:07.775745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:07.784079 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.784642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.785077 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.786023 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:07.786800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:07.787416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:07.963660 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:07.973587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fa44592c-fdc6-4abf-9c26-dde53e5b79ac tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.204522 Sep 06 16:16:07.974484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 137/253] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:07 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:08.159328 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:08.161203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:08.171912 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:08.172455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:08.173033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:08.174034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:08.174961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:08.175134 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:08.332710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:08.341553 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d34a9833-a084-4390-b84d-4a1d37566824 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.190167 Sep 06 16:16:08.342154 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 117/254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:08 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:09.016526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:09.018490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:09.036376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.037058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.037822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.038562 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.039048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.039476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.317220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.334733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-63cd31b7-8f46-47a6-9ff5-9c1119f0335e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1503 microversion: 2.1 time: 0.322954 Sep 06 16:16:09.336088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 138/255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:09 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:09.367750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:09.368436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:09.380387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.380895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.381338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.382143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.382619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.383443 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.665401 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:09.683905 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-04ac6d5e-ca1e-45d3-9a4c-d6f9987521d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.321003 Sep 06 16:16:09.685065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 118/256] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:09 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:09.694092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-5164bfe4-5c73-419a-8513-7e95f2e3f384 req-bf2befae-204e-4599-bddd-6c83d32577b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8113b2f3-9edb-4717-b0b4-22bfe5b5e225", "name": "network-vif-deleted", "tag": "f80d0f7c-52b4-4edc-a756-ffda4f7feceb"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:09.714159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5164bfe4-5c73-419a-8513-7e95f2e3f384 req-bf2befae-204e-4599-bddd-6c83d32577b4 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:09.715044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5164bfe4-5c73-419a-8513-7e95f2e3f384 req-bf2befae-204e-4599-bddd-6c83d32577b4 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:09.716233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5164bfe4-5c73-419a-8513-7e95f2e3f384 req-bf2befae-204e-4599-bddd-6c83d32577b4 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:09.733752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-5164bfe4-5c73-419a-8513-7e95f2e3f384 req-bf2befae-204e-4599-bddd-6c83d32577b4 service nova] Creating event network-vif-deleted:f80d0f7c-52b4-4edc-a756-ffda4f7feceb for instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 on hv-cinder-85220 Sep 06 16:16:09.740960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-5164bfe4-5c73-419a-8513-7e95f2e3f384 req-bf2befae-204e-4599-bddd-6c83d32577b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056703 Sep 06 16:16:09.741592 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 139/257] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:10.365319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:10.365847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:10.374123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.374858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.375054 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.375774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.376328 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.376758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.418030 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.418434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.418923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.419372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lazy-loading 'fault' on Instance uuid 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:10.468401 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:10.480563 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-15bea82b-77bd-4194-9de5-0c08ea47efb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 200 len: 1304 microversion: 2.1 time: 0.120054 Sep 06 16:16:10.481149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 119/258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:10 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:10.714207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:10.715523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:10.729612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.730419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.731338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.732498 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:10.733393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:10.734329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:10.962143 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:10.976140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b985f7f8-ae09-4f1e-acc6-e99add9f9ba3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.269202 Sep 06 16:16:10.977075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 140/259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:10 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:11.199596 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:11.201185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:11.221054 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.222403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.223779 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.226710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.228710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.231078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.272369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] HTTP exception thrown: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Request method failure captured: Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 HTTP/1.1 Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HgH0d3mUo12PV35ghNbA0wThM1unVH6SUHtgJtmIev9zjcUvqSfzVZDCxgCaKFzSk3wua6yVniBf_7GKBEIxE4b-A0oOrWYl-Q1VGQlQrnaKGWU1w31WTfQVOWrTEQFMJo0JmieQnhQuTJMWREuY7LUEMWGLEjk8Pbi-4ZLcaGgc4 Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:16:11.276362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 668452994ad942069d30f4bddbba15b4 Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.279245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': 'eec48627-7548-4e6c-87fd-4a024c9a5f40'} Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:16:11.280799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.284909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.288533 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Returning 404 to user: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:16:11.288533 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3d65957a-ebf0-4a82-8148-039122402f65 tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 404 len: 111 microversion: 2.1 time: 0.096053 Sep 06 16:16:11.288533 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 120/260] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:16:11 2022] DELETE /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:16:11.293156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:11.294253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] [instance: eec48627-7548-4e6c-87fd-4a024c9a5f40] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:11.306137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.306973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.307512 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.308941 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.309748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.310817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.337303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] HTTP exception thrown: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Request method failure captured: Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 HTTP/1.1 Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HgH0d3mUo12PV35ghNbA0wThM1unVH6SUHtgJtmIev9zjcUvqSfzVZDCxgCaKFzSk3wua6yVniBf_7GKBEIxE4b-A0oOrWYl-Q1VGQlQrnaKGWU1w31WTfQVOWrTEQFMJo0JmieQnhQuTJMWREuY7LUEMWGLEjk8Pbi-4ZLcaGgc4 Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:16:11.339213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c5974f0b22a7493da25b0b0aaa21c66b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: c5974f0b22a7493da25b0b0aaa21c66b Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-DeleteServersTestJSON-159151006 Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 668452994ad942069d30f4bddbba15b4 Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-DeleteServersTestJSON-159151006-project Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.341970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'eec48627-7548-4e6c-87fd-4a024c9a5f40'} Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:16:11.343425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. Sep 06 16:16:11.345586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.347909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] Returning 404 to user: Instance eec48627-7548-4e6c-87fd-4a024c9a5f40 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:16:11.347909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-19403805-40ed-4795-add2-194fa8244f9e tempest-DeleteServersTestJSON-159151006 tempest-DeleteServersTestJSON-159151006-project] 10.222.0.26 "GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40" status: 404 len: 111 microversion: 2.1 time: 0.054021 Sep 06 16:16:11.347909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 141/261] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:11 2022] GET /compute/v2.1/servers/eec48627-7548-4e6c-87fd-4a024c9a5f40 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:16:11.515834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:11.518482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: 8113b2f3-9edb-4717-b0b4-22bfe5b5e225] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:11.529764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.530676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.531561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.534024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:11.535235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:11.536279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:11.579249 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] HTTP exception thrown: Instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 could not be found. Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Request method failure captured: Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 HTTP/1.1 Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3INTfIByDBgDiQe06j_08IctkoKBT_NafrpfhYzZIvkmyMEiZGQxPnl0S38uHTGCejAJyGgb-41Zft4w6KlvT27FEWrM88MweZfZ6h0F7UEu583CYPX4h6Xw9gCEuG5ZeVX8POoPPFU-72iWff7TO4Ayix4gX3Rl7tmmlGVqOOhe0s Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: f124871e909842f4b74ef9fb483f5dd9 Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesActionsTest-1238362789 Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:16:11.583807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesActionsTest-1238362789 Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: f124871e909842f4b74ef9fb483f5dd9 Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesActionsTest-1238362789 Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesActionsTest-1238362789-project Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: b24f1542cddf4fc9aa8003952e26cb96 Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesActionsTest-1238362789-project Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 could not be found. Sep 06 16:16:11.585334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '8113b2f3-9edb-4717-b0b4-22bfe5b5e225'} Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 could not be found. Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:16:11.586217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 could not be found. Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 could not be found. Sep 06 16:16:11.587544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:16:11.588726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Returning 404 to user: Instance 8113b2f3-9edb-4717-b0b4-22bfe5b5e225 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:16:11.588726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fc98fb81-12b1-4798-8a9b-e509457c69ec tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225" status: 404 len: 111 microversion: 2.1 time: 0.084119 Sep 06 16:16:11.588726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 121/262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:11 2022] GET /compute/v2.1/servers/8113b2f3-9edb-4717-b0b4-22bfe5b5e225 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:16:11.738415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1572741742", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "networks": [{"uuid": "759a6db1-4613-4095-bc4d-b82749165525"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:11.812578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] validate_networks() for [('759a6db1-4613-4095-bc4d-b82749165525', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:16:12.020751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:12.022258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:12.034920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:12.036193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:12.036971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:12.038709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:12.039606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:12.040378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:12.429146 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:12.447889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1071eb1d-af48-426f-9186-07e24ed9022b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.437647 Sep 06 16:16:12.452197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 122/263] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:12 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:13.316260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:16:13.316982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:16:13.317361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:16:13.324430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:16:13.326015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:16:13.352464 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.353889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.355102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.356343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.357273 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.360047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.390999 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Getting quotas for project f124871e909842f4b74ef9fb483f5dd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:13.396657 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Getting quotas for user b24f1542cddf4fc9aa8003952e26cb96 and project f124871e909842f4b74ef9fb483f5dd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:13.410686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:16:13.413217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:16:13.483648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:13.486400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:13.494417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bfe5d778-36c3-4c12-9e6e-54b8e718f4bf tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763180 Sep 06 16:16:13.500574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.501789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 142/264] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:16:13.502131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.503326 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.505074 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:13.506207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:13.507293 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:13.507467 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2cda0faf-7235-4da4-a148-813d7d4b766d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:13.507980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2cda0faf-7235-4da4-a148-813d7d4b766d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:13.647733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2cda0faf-7235-4da4-a148-813d7d4b766d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.658836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2cda0faf-7235-4da4-a148-813d7d4b766d tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1214 microversion: 2.1 time: 0.155735 Sep 06 16:16:13.659425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 143/265] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:13 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:13.812784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:13.822926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-efd5b172-433f-44a6-9ee3-76a641623c93 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.346119 Sep 06 16:16:13.823526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 123/266] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:13 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:14.684736 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:14.685814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:14.705243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.705748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.706198 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.706984 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.707452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.707878 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.827076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:14.841774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-89e41918-f100-49ba-8922-b94e71c2928b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1210 microversion: 2.1 time: 0.161259 Sep 06 16:16:14.842450 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 144/267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:14 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:14.866991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:14.874370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:14.908329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.920371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.924412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:14.928747 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:14.932716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:14.935655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.246512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:15.312945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1e8c9e8d-82b2-413c-a397-f10fc161f1e9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.464023 Sep 06 16:16:15.317515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 124/268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:14 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:15.872325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:15.873397 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:15.919250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.920715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.924389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:15.925421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:15.926112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:15.926839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:16.191527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:16.208982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d00d803c-1cd8-4648-bb3f-9916179dd755 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1266 microversion: 2.1 time: 0.342317 Sep 06 16:16:16.210216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 145/269] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:15 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:16.345327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:16.347271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:16.363645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:16.364263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:16.364862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:16.365719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:16.366185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:16.366623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:16.655844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:16.688011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-53bae7a7-85af-42f9-a2bb-649dfab56dfc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.348162 Sep 06 16:16:16.700959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 125/270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:16 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:17.257344 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:17.258898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:17.268168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.271865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.273711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:17.282820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.283911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.284498 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:17.547525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:17.561146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3c0fe51f-92ab-4462-8a6f-fc310e50f65e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1272 microversion: 2.1 time: 0.310212 Sep 06 16:16:17.562064 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 146/271] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:17 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:17.720748 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:17.723688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:17.738590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.740870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.741728 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:17.744299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:17.745228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:17.746193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.212986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:18.222873 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fc92f204-f4ee-4297-9b2c-cd0cf714a22c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.512742 Sep 06 16:16:18.223647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 126/272] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:17 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:18.605346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:18.608024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:18.637650 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.638146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.638581 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:18.639323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:18.639781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:18.640309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.170243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.184491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-36c23d1b-9b3e-44ab-a244-db8d98f1bdb8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.586817 Sep 06 16:16:19.193325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 147/273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:18 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:19.252365 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:19.253898 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:19.261799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.262635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.264643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.265738 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:19.266912 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:19.268482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:19.463642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:19.474388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6161a63c-4cc7-4456-8356-631db2307aa8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.227002 Sep 06 16:16:19.476163 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 127/274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:19 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:20.213100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.214637 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:20.222964 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.223941 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.224735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.225724 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.226564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.227469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.437362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:20.451676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-659bb104-383f-44e5-beac-8955481d75d2 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.247637 Sep 06 16:16:20.452926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 148/275] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:20.517107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:20.519598 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:20.533613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.535018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.535978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.537929 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:20.539658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:20.540680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:20.757127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:20.769545 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-68251f6c-8033-4c99-8054-f6a050bcc8c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.259375 Sep 06 16:16:20.771049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 128/276] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:20 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:21.481287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:21.483454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:21.494909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.496064 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.497091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.498681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.499730 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.500802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.752383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:21.758854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:21.767525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c0e400de-a361-4835-b702-60c586eb1edc tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.293499 Sep 06 16:16:21.768496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 149/277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:21 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:21.797571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:21.799275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:21.806780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.807499 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.808247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.809156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:21.809722 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:21.810502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:21.816150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:21.986578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:22.010913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-faf6d7cf-9039-4732-b0f5-b390c80a8c02 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.217125 Sep 06 16:16:22.011693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 129/278] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:21 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:22.791658 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:22.792493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:22.809246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.809802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.810750 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:22.811748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:22.812633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:22.814585 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.037405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:23.038932 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:23.053324 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.054086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.054817 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.056338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.060315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.060867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.377017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:23.396180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:23.412660 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a44b2851-ef32-4cc9-a7e4-47ff23e4daaf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.379425 Sep 06 16:16:23.415317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 130/279] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:23 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:23.453582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:23.464638 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d21997c4-75aa-435d-99bd-4bb62ec31698 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.676889 Sep 06 16:16:23.479308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 150/280] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:22 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:23.746783 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-186fa64e-e8fa-4004-b3c3-a981d332cdf2 req-4552e623-9147-4920-9469-c35b7ceed62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43c9441-d084-4b6b-9613-15998b512fbd", "tag": "45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:23.765775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=72 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:23.770858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-186fa64e-e8fa-4004-b3c3-a981d332cdf2 req-4552e623-9147-4920-9469-c35b7ceed62e service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:23.773945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-186fa64e-e8fa-4004-b3c3-a981d332cdf2 req-4552e623-9147-4920-9469-c35b7ceed62e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:23.777731 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-186fa64e-e8fa-4004-b3c3-a981d332cdf2 req-4552e623-9147-4920-9469-c35b7ceed62e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:23.807405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-186fa64e-e8fa-4004-b3c3-a981d332cdf2 req-4552e623-9147-4920-9469-c35b7ceed62e service nova] Creating event network-changed:45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2 for instance f43c9441-d084-4b6b-9613-15998b512fbd on hv-cinder-85220 Sep 06 16:16:23.818169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-186fa64e-e8fa-4004-b3c3-a981d332cdf2 req-4552e623-9147-4920-9469-c35b7ceed62e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090681 Sep 06 16:16:23.820295 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 131/281] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:24.441081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:24.441916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:24.444217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=8 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:24.445504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:24.453053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.453649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.454894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.456994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.457589 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.458416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.495594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:24.503458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:24.522234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.523307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.534403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.535566 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:24.537423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:24.538151 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:24.695697 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.704587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ae2cd31-d5f9-4877-a65f-3914f30dcd97 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.270013 Sep 06 16:16:24.706009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 151/282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:24 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:24.958382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:24.966572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1412982b-61c7-49e7-adc5-ad9105d722ad tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.479605 Sep 06 16:16:24.967799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 132/283] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:24 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:25.743420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:25.743420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:25.768715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.769206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.769636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.770336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:25.770807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:25.771223 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:25.991867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:25.993137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:26.008708 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.009469 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.010060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:26.010965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:26.011576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:26.012185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:26.055353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:26.065873 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-05e1bc12-a5ec-475d-adfd-ee7500b90f4e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.326942 Sep 06 16:16:26.067052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 152/284] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:25 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:26.685479 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:26.698410 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ec66e175-bcfc-4c5a-9f07-8e59b218143f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.710318 Sep 06 16:16:26.699448 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 133/285] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:25 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:27.089230 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:27.089832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:27.097000 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.097803 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.098302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.099101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.099609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.100242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.427305 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:27.440407 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-80cd0ae4-12d9-4cd5-8734-475be5a998cb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.354789 Sep 06 16:16:27.441010 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 153/286] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:27 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:27.731567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:27.732354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:27.740762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.741506 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.742119 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:27.744633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:27.745417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:27.746068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.199550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.221283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6fa1a72c-f5f7-4666-8c77-46d54a925924 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.502621 Sep 06 16:16:28.224016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 134/287] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:27 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:28.470733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:28.475532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:28.493832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.498009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.499323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.502504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:28.503454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:28.505207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:28.861721 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:28.872685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f3d852a8-9e3a-40ef-9c10-8e3ed9eeab7e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1520 microversion: 2.1 time: 0.410721 Sep 06 16:16:28.889448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 154/288] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:28 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:29.250465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:29.251243 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:29.260116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.260878 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.261548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.262797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.263930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.265144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.724444 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:29.769220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bb69d807-c76f-4824-8d0a-e789faef982b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.523801 Sep 06 16:16:29.772262 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 135/289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:29 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:29.925116 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:29.926935 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:29.940664 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.942200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.943369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:29.944801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:29.945596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:29.946340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.195082 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:30.206982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f917d59b-684a-44db-99ac-3bbb1c6f7569 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1500 microversion: 2.1 time: 0.311579 Sep 06 16:16:30.227165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 155/290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:29 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:30.233377 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:30.234188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:30.241621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.242515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.243176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.244068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.244738 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.245369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.505157 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:30.525441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a87fd813-4de7-418e-af20-0203eee8a333 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1515 microversion: 2.1 time: 0.296523 Sep 06 16:16:30.526718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 136/291] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:30 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1515 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:30.557695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e8f5b50-bb27-444f-bb7d-2cbe7e2b9cf3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'create', calling method: .version_select at 0x7f21b8177550>, body: {"keypair": {"name": "tempest-keypair-451229691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2MxMG4kd0v4QZM2WwaPM6wpW3RI2QeQXOtuCCrqGflgqfW+uxsbKAFULvcO0/bmOHO3XtcaYERvGvkvzu5M0k5FO3my8QDOK8pucYpaxlnhNsxFrpI5YkPHtXII4eBA=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:30.616748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-3e8f5b50-bb27-444f-bb7d-2cbe7e2b9cf3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for project b52ac4a27fe84303970a9f7e104c5298. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:30.629568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-3e8f5b50-bb27-444f-bb7d-2cbe7e2b9cf3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for user 72cc5f5b1b6b4fb28d57c7ff7931fdff and project b52ac4a27fe84303970a9f7e104c5298. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:30.724197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3e8f5b50-bb27-444f-bb7d-2cbe7e2b9cf3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.437043 Sep 06 16:16:30.727624 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 156/292] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:16:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:16:30.817668 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:30.818232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:30.831500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.832387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.832909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:30.835647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:30.836570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:30.837246 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:31.868190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:31.879578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-190fc4eb-284b-46a0-a9f1-5c540f1753a3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 1.067253 Sep 06 16:16:31.897710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 137/293] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:30 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:32.904234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:32.904844 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:32.919379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.919932 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.920370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:32.921119 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:32.921569 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:32.921989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.704775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:33.712959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:33.733069 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.738087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.739296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.744171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:33.747964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:33.748707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:33.820481 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lazy-loading 'flavor' on Instance uuid e574f9ab-e5b1-4762-bf2e-211d8fd993fa {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:16:33.837789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:33.850985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-32f18e39-d8c3-4ba4-afa6-086ee1f338a7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.950483 Sep 06 16:16:33.853626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 157/294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:32 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:34.011508 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1841724644", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87b59ecc-5db9-4aa4-8f2c-2efc340f1ba7"}], "security_groups": [{"name": "tempest-securitygroup--63812148"}], "key_name": "tempest-keypair-451229691", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:34.025939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-03aaa620-e0ff-43b2-a14e-8ec1f5423893 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa/action" status: 200 len: 32 microversion: 2.1 time: 0.329194 Sep 06 16:16:34.027632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 138/295] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:16:33 2022] POST /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 16:16:34.042405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:34.043281 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:34.050977 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.051675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.052105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.052830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.053291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.053722 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.189889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] validate_networks() for [('87b59ecc-5db9-4aa4-8f2c-2efc340f1ba7', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:16:34.424229 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:34.440163 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3f3d417e-ff18-4780-a2db-cd798057df54 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.403902 Sep 06 16:16:34.453152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 139/296] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:34 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:34.881047 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:34.881702 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:34.898505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.898958 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.900262 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:34.900262 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:34.900707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:34.901026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.030384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:16:35.031535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:16:35.033013 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:16:35.033596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:16:35.034173 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:16:35.048719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.049463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.050053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.051028 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.051667 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.053088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.117495 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for project b52ac4a27fe84303970a9f7e104c5298. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:16:35.123475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for user 72cc5f5b1b6b4fb28d57c7ff7931fdff and project b52ac4a27fe84303970a9f7e104c5298. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:16:35.151759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:16:35.155510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:16:35.306288 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-62b1bffb-88ef-4aef-83cb-1d95c7144c51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.300448 Sep 06 16:16:35.307078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 158/297] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:16:34 2022] POST /compute/v2.1/servers => generated 400 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 16:16:35.327124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1e935727-43d6-4b4a-8727-2a7c136523e2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:35.329545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1e935727-43d6-4b4a-8727-2a7c136523e2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:35.342118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:35.380255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fbfbc2c8-910d-4320-bc7e-a48abeb41f27 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.476040 Sep 06 16:16:35.382885 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 140/298] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:34 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:35.479019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:35.481039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:35.497075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.500611 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.501463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.502313 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:35.503623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:35.505131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:35.531192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1e935727-43d6-4b4a-8727-2a7c136523e2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:35.539484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1e935727-43d6-4b4a-8727-2a7c136523e2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1237 microversion: 2.1 time: 0.223468 Sep 06 16:16:35.551232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 159/299] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:35 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1237 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:35.991787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.008170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fd9ecee1-3876-4b73-9615-698281c8e440 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.533035 Sep 06 16:16:36.008776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 141/300] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:35 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:36.413488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:36.414970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:36.435311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.436795 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.438138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.439770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.440635 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.441506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.570971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:36.575752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:36.595488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.605252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.606546 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.607791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:36.608711 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:36.609405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:36.713500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.723297 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2f22c44a-3d8c-48f6-a627-b469569af71d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1233 microversion: 2.1 time: 0.161573 Sep 06 16:16:36.724281 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 142/301] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:36 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1233 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:36.802362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:36.820794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d084a1d3-6ae9-44b6-af5b-ffa64f04e915 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.410662 Sep 06 16:16:36.821836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 160/302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:36 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:37.041606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:37.043478 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:37.056714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.057222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.057680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.061531 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.062157 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.062637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.355071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.365808 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cfe8e8f6-7354-4a87-83b8-74017fd42831 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.335399 Sep 06 16:16:37.366873 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 143/303] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:37 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:37.752610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:37.753646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:37.760391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.760970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.761462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.762224 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.762774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.763378 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.849302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:37.850920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:37.858717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.859816 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.860964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.861967 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:37.862364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:37.863003 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:37.883968 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:37.884688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:37.923518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7dd2009c-f157-44e8-96e2-5ef8bf6a0499 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1289 microversion: 2.1 time: 0.161654 Sep 06 16:16:37.928171 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 161/304] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:37 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1289 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:38.274693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:38.298248 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-adb36eed-2d95-4c50-bf53-ea281e4a56bb tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.453393 Sep 06 16:16:38.314389 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 144/305] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:37 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:38.397608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:38.398256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:38.407757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.408355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.409004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.409776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.410588 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.411237 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.886347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:38.905168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6b4d3146-3eeb-4013-93ea-f8205180a376 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.505543 Sep 06 16:16:38.906169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 162/306] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:38 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:38.958038 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:38.960130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:38.983378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.986972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:38.989575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:38.993871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:38.997569 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.000115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.086715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-7b53fd10-0f73-4fbd-af07-a00179205590 req-d5af5bee-3c09-4a31-abdb-bed43504071d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43c9441-d084-4b6b-9613-15998b512fbd", "name": "network-vif-plugged", "status": "completed", "tag": "45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:39.119559 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7b53fd10-0f73-4fbd-af07-a00179205590 req-d5af5bee-3c09-4a31-abdb-bed43504071d service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.120074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7b53fd10-0f73-4fbd-af07-a00179205590 req-d5af5bee-3c09-4a31-abdb-bed43504071d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.120513 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7b53fd10-0f73-4fbd-af07-a00179205590 req-d5af5bee-3c09-4a31-abdb-bed43504071d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.168497 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-7b53fd10-0f73-4fbd-af07-a00179205590 req-d5af5bee-3c09-4a31-abdb-bed43504071d service nova] Creating event network-vif-plugged:45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2 for instance f43c9441-d084-4b6b-9613-15998b512fbd on hv-cinder-85220 Sep 06 16:16:39.186162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-7b53fd10-0f73-4fbd-af07-a00179205590 req-d5af5bee-3c09-4a31-abdb-bed43504071d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104576 Sep 06 16:16:39.198260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 163/307] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:16:39.324075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:39.325028 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:39.342436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.343048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.343766 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.343970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:39.346291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.349615 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.353128 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.360952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4624c785-85ec-4019-b808-a7461fffcc86 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1295 microversion: 2.1 time: 0.407663 Sep 06 16:16:39.367589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 145/308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:38 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1295 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:39.936928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:39.937728 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:39.951726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.953476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.955078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:39.956071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:39.957320 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:39.957992 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.343899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:40.353886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da1ff8b2-7b62-44f4-8f23-cdcebd02ed22 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 1.035395 Sep 06 16:16:40.376957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 164/309] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:39 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:40.401678 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:40.415928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:40.416547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:40.425329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-97ceed07-d4dc-46ff-8b46-147dc65e89df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.492763 Sep 06 16:16:40.427343 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 146/310] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:39 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:40.452208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.452708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.458801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.459288 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:40.459883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:40.460200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:40.785017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:40.801629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-024059a9-4c5e-4eb5-81c4-0897c1b39767 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.392437 Sep 06 16:16:40.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 165/311] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:40 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:41.392649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:41.393418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:41.413227 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.419651 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.420095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.420855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.424105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.426083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.451961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:41.452572 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:41.476980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.477504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.483719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.489204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.489695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.490883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.757819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:41.776372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c67c6987-61eb-4dae-819b-95c1d9e2eba4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1314 microversion: 2.1 time: 0.390954 Sep 06 16:16:41.777975 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 147/312] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:41 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:41.829635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:41.830269 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:41.858943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.859450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.864778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:41.865933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:41.866432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:41.870288 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.313476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.325598 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-df5f5151-dcc7-40a8-a34a-acfcddbf238b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.877707 Sep 06 16:16:42.333740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 166/313] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:41 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:42.496153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:42.520882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cb52b5c2-edc5-4ac4-9cf9-372c84038595 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.695336 Sep 06 16:16:42.526200 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 148/314] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:41 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:42.836594 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:42.836594 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:42.840619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.841296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.841914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:42.843124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:42.843898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:42.845005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.038317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-81510e13-4892-4846-b49b-fe52c799735b req-cf084894-6b28-4b3e-bd17-88b3b747a3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d89aa26-192e-4016-93ea-772996bb9e49", "tag": "d1ec24f6-7663-4504-af80-9955a9372f97"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:16:43.058470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-81510e13-4892-4846-b49b-fe52c799735b req-cf084894-6b28-4b3e-bd17-88b3b747a3dd service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.059535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-81510e13-4892-4846-b49b-fe52c799735b req-cf084894-6b28-4b3e-bd17-88b3b747a3dd service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.062388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-81510e13-4892-4846-b49b-fe52c799735b req-cf084894-6b28-4b3e-bd17-88b3b747a3dd service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.089048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-81510e13-4892-4846-b49b-fe52c799735b req-cf084894-6b28-4b3e-bd17-88b3b747a3dd service nova] Creating event network-changed:d1ec24f6-7663-4504-af80-9955a9372f97 for instance 1d89aa26-192e-4016-93ea-772996bb9e49 on hv-cinder-85220 Sep 06 16:16:43.103883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-81510e13-4892-4846-b49b-fe52c799735b req-cf084894-6b28-4b3e-bd17-88b3b747a3dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069427 Sep 06 16:16:43.104495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 149/315] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:16:43.352531 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:43.353500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:43.370619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.371951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.372279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.374014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.375458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.377864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.600117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.611959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ad9a978a-a115-4706-8ae4-3566880015a6 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1498 microversion: 2.1 time: 0.807916 Sep 06 16:16:43.612902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 167/316] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:42 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1498 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:43.617961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:43.619005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:43.627199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.627974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.628636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.629696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:43.630355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:43.631022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:43.921681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:43.934475 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e011230b-d3bf-4cf6-8bfb-55cdb6001207 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.588522 Sep 06 16:16:43.935303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 150/317] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:43 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:44.000313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:44.011426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6f45b37c-13b8-4a08-8db0-916282f127f5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.397315 Sep 06 16:16:44.012393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 168/318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:43 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:44.668428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:44.669128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:44.679558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.685281 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.685848 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.686737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.687326 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.689396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.757316 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:16:44.909436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-582f2b4b-1f36-44ab-ba39-702e6b255a84 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 204 len: 0 microversion: 2.1 time: 0.251133 Sep 06 16:16:44.910508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 151/319] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:16:44 2022] DELETE /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:16:44.919440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:44.920655 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:44.929626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.930199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.934945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.937006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.937642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.939208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.965874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:44.966778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:44.992486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.992991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.993460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:44.994177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:44.994624 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:44.995107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.108158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:45.140745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:45.145574 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:45.159516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b7943021-f1c1-4b56-8001-b19be859eaaa tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.244294 Sep 06 16:16:45.160970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 169/320] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:44 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:45.166764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:45.167382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:45.174521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.175096 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.175814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.176701 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:45.177287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:45.177852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:45.261497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:45.272014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c3c87361-20ce-4c87-9a72-420a976daa21 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.313723 Sep 06 16:16:45.275828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 152/321] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:44 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:45.350523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:45.394911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-96d2a1ae-a39a-42be-a883-78030de3b813 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.232109 Sep 06 16:16:45.395553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 170/322] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:45 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:46.194145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:46.197768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:46.220915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.222480 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.224928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.228452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.229276 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.230100 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.297995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:46.299299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:46.301557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=12 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:46.307779 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.308266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.308710 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.309399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.309856 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.310277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.519833 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:46.531520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-654f09ca-20d1-40bb-94f7-b78968e1595b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.237849 Sep 06 16:16:46.534191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 171/323] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:46 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:46.541925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:46.543298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:46.551950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.552639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.553211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.554094 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:46.554652 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:46.555212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:46.709407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:46.720528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-286373fe-c554-435b-a45b-cb54395b2ef4 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.536902 Sep 06 16:16:46.724402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 153/324] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:46 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:46.975195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:46.984034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b09795f6-78ea-4e9e-bfad-dca68af32e7b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.448396 Sep 06 16:16:46.985700 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 172/325] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:46 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:47.557376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:47.557950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:47.565354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.565845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.566279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.567199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.567873 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.568354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.770851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:47.771462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:47.778285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.778825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.779270 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.784607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:47.785398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:47.786032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:47.808187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:47.825081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d9f08ed4-17d3-49a8-b214-6f40b1a8e60c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.272183 Sep 06 16:16:47.839869 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 154/326] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:47 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:48.008913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:48.009555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:48.019916 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.022432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.023502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.026445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.029098 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.029788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.059272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.070506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-34243831-3a93-47d6-8314-732c84fedaba tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.308308 Sep 06 16:16:48.071636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 173/327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:47 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:48.327601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:48.338043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fb8681fb-b444-4d2c-b197-b963c2577d8c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.333412 Sep 06 16:16:48.366789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 155/328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:48 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:48.863960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:48.867445 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:48.877443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.878280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.878980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:48.880063 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:48.880429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:48.880904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.100272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:49.101909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:49.108731 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.109541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.111142 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.112354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.113042 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.113471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.192299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.205652 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-abe5f273-c5df-48d5-9cec-c21b7ab058d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.346275 Sep 06 16:16:49.207483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 174/329] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:48 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:49.373121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:49.375177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:49.383009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.384174 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.384857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.385660 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:49.386335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:49.386992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:49.446384 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.457355 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8ca627d5-f77b-4a95-a80c-13fbecd3fe37 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.363160 Sep 06 16:16:49.464803 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 156/330] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:49 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:49.554611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:49.578382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0fdf59ae-922c-4b1f-8657-95806f60b82a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.207947 Sep 06 16:16:49.582711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 175/331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:49 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:50.232796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:50.233418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:50.254881 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.255887 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.256745 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.258130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.259322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.260175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.481636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:50.482235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:50.489035 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.489616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.490313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.491146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.491678 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.492184 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.505231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.519296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8c86823f-c7d1-46c2-9842-30af6083c518 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.292292 Sep 06 16:16:50.520539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 157/332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:50 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:50.602506 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:50.603306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:50.616251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.617056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.617508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.618184 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:50.618994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:50.619612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:50.683754 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.693842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ff35df21-5fde-4bcb-b7e5-8d91bc025907 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.216160 Sep 06 16:16:50.694710 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 176/333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:50 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:50.862165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:50.872963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ad4b5543-afb0-4716-b72e-848ea63fb30a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.274203 Sep 06 16:16:50.873719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 158/334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:50 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:51.543600 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:51.544855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:51.551917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.552682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.553115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.553826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.554289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.554880 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.724391 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:51.726285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:51.753744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.754958 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.756599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.757909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.759301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.760004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.783515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:51.799616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2250273e-900e-4099-977c-235a40ecac0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.259747 Sep 06 16:16:51.803214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 177/335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:51 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:51.905370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:51.910608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:51.930385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.931949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.933373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:51.935524 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:51.936294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:51.936942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:52.002083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:52.021780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-08d88e86-7640-4d66-b209-16657d5d36d7 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.304592 Sep 06 16:16:52.032860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 159/336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:51 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:52.176583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:52.186188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dcd3054a-f2a7-4a44-a018-324abcd4f2bf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.288287 Sep 06 16:16:52.187863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 178/337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:51 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:52.840848 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:52.842105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:52.849111 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:52.849594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:52.850030 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:52.850765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:52.851399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:52.852046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:52.855369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:53.045179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:53.045886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:53.057320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.057824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.058266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.060106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.061569 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.062012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.092285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.102367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bfd5378a-2aa6-4af6-8fa9-d70029bf9213 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.265194 Sep 06 16:16:53.103353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 160/338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:52 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:53.209663 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:53.210322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:53.219383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.219884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.220335 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.221056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:53.221657 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:53.222280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:53.265544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.292366 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d73ae3b1-47d2-4b81-a5ac-69a9bfa066a0 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.250816 Sep 06 16:16:53.294343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 179/339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:53 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:53.467681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:53.479493 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-774c87b6-0949-4221-9f83-bb12021b7cbf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.273714 Sep 06 16:16:53.487709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 161/340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:53 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:54.135944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:54.139849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:54.157372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.159926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.164858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.166900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.168662 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.169709 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.339250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:54.341171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:54.343780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:54.357036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.357798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.358426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.359562 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.364546 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.365801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.455560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.464221 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0fd765e5-f8e8-4a65-80dc-27d85545577b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.335294 Sep 06 16:16:54.465588 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 180/341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:54 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:54.538260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:54.538925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:54.540992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:54.550362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.550896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.551338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.552052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:54.552504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:54.552930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:54.689982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.701592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-beea7230-5b4d-4a11-a173-aa4fe0e88615 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.366246 Sep 06 16:16:54.714002 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 162/342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:54 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:54.870275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:54.882272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d96bd53d-7e46-4d40-8612-e8add13fb296 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.347404 Sep 06 16:16:54.883063 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 181/343] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:54 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:55.511593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:55.512281 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:55.531365 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.538984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.548232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.550161 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.551866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.552332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.754956 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:55.755828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:55.777607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.778098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.778535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.779303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.779756 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.780177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.836310 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.851562 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a25dfa39-bffc-4e1b-85ae-1f6d3e1c0d17 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.344438 Sep 06 16:16:55.852702 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 163/344] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:55 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:55.907434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:55.908517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:55.917887 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.918873 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.919939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.920842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:55.921451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:55.922034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:55.941654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:55.951096 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-22346aa9-9d3a-4a8c-a05a-c9f0ffa2ca0b tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.220739 Sep 06 16:16:55.953088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 182/345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:55 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:56.095266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:56.104017 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8ea5d56c-bc15-4ed9-b1b2-ce8b1809f7a7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.201140 Sep 06 16:16:56.111388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 164/346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:55 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:56.880715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:56.882791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:56.894577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.900612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.901060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.902007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.905471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.905932 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.979934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:56.980899 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:56.990767 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.991661 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.992252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:56.993152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:56.993677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:56.994312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.155064 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:57.165907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-58f5ec14-c212-4aea-bb54-925b85bb9410 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.290754 Sep 06 16:16:57.185057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 183/347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:56 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:57.191272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:57.192127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:57.199395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.200763 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.201368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.202265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:57.203119 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:57.205382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:57.229644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:57.248725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-29c92bda-0b7f-458b-95b5-77d29cb212f3 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.272434 Sep 06 16:16:57.249492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 165/348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:56 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:16:57.409348 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:57.417461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-18bfacc9-c50f-4d4a-99a9-99ad8946b3f8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.231016 Sep 06 16:16:57.420423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 184/349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:57 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:58.191413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:58.204420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:58.222488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.223316 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.224576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.225512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.226133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.226763 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.274514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:58.275522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:58.282611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.283345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.283995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.284928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.285483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.285969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.455682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.465456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-60bfb3e0-1791-4462-b441-cd728c210d7c tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.196479 Sep 06 16:16:58.466649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 185/350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:58 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:58.471764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:58.472620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:58.479152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.479919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.480522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.481398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:58.482011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:58.482430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:58.498578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.509447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6cf38e02-098c-43db-9aff-14ab9f7f05d1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.322654 Sep 06 16:16:58.509673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:16:58.524839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 166/351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:58 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:58.646728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:58.657301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-11f897f7-ee6c-4c91-a8ee-eeb1b24d098b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.189271 Sep 06 16:16:58.670685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 186/352] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:58 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:59.493676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:59.495064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:59.502442 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.503818 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.504961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.505972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.506452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.506941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.537753 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:59.538959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:59.545216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.545702 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.546133 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.546854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.547379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.547922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.686698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.698896 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-246b5f75-804f-43a6-bf00-e9ef6ebd7288 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.209053 Sep 06 16:16:59.715179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 167/353] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:59 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:59.717893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.721095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:16:59.721945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:16:59.728319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.729091 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.729524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.729723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4b77ab1b-4396-4b2c-bbb6-e1a86a7cc988 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.196070 Sep 06 16:16:59.730224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:16:59.730463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 187/354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:59 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:16:59.730693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:16:59.731122 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:16:59.934870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:16:59.944159 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-01abe749-a336-46cf-bfbe-2d6f10c5791b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.227577 Sep 06 16:16:59.962372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 168/355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:16:59 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:00.728293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:00.728969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:00.737350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.739316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.740105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.742597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.744395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.745377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.756740 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:00.758168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:00.769610 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.770115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.770562 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:00.771399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:00.771860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:00.788417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:01.091953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:01.108552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2a01fd62-94df-405b-886c-b2bb9e9df05f tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.385782 Sep 06 16:17:01.110448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 188/356] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:00 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:01.117862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:01.119054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:01.131308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:01.133477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:01.134826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:01.136762 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:01.138840 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:01.139939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:01.206976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:01.216486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fd3c277e-5f7d-4540-9e78-685a51c4a299 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.463512 Sep 06 16:17:01.217787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 169/357] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:00 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:01.419704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:01.428880 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d3d8dc1b-4ee6-4be0-8e57-f90f2ab5a3ee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.316637 Sep 06 16:17:01.430838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 189/358] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:01 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:02.135609 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:02.136295 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:02.156868 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.163474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.165280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.166644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.167138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.167574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.258545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:02.259339 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:02.284697 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.285222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.285668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.286386 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.286903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.287401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.405065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.420609 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f1c0803e-6b79-4407-a2c8-9b2f3bd6913e tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.288518 Sep 06 16:17:02.423879 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 170/359] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:02 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:02.457810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:02.458969 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:02.475203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.479958 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.480625 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.481607 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.483121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.483317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.568206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:02.602253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e10a53b3-bea9-45a9-87b5-a9e1c1bc1a8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.340264 Sep 06 16:17:02.608142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 190/360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:02 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:02.721896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-15a9c5b2-ec20-4c11-a1d5-3200b410d6e2 req-375ddefe-dafa-45ca-9390-2e275d42ddfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d89aa26-192e-4016-93ea-772996bb9e49", "name": "network-vif-plugged", "status": "completed", "tag": "d1ec24f6-7663-4504-af80-9955a9372f97"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:02.740572 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-15a9c5b2-ec20-4c11-a1d5-3200b410d6e2 req-375ddefe-dafa-45ca-9390-2e275d42ddfa service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:02.741058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-15a9c5b2-ec20-4c11-a1d5-3200b410d6e2 req-375ddefe-dafa-45ca-9390-2e275d42ddfa service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:02.741492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-15a9c5b2-ec20-4c11-a1d5-3200b410d6e2 req-375ddefe-dafa-45ca-9390-2e275d42ddfa service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:02.798412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-15a9c5b2-ec20-4c11-a1d5-3200b410d6e2 req-375ddefe-dafa-45ca-9390-2e275d42ddfa service nova] Creating event network-vif-plugged:d1ec24f6-7663-4504-af80-9955a9372f97 for instance 1d89aa26-192e-4016-93ea-772996bb9e49 on hv-cinder-85220 Sep 06 16:17:02.850828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-15a9c5b2-ec20-4c11-a1d5-3200b410d6e2 req-375ddefe-dafa-45ca-9390-2e275d42ddfa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116643 Sep 06 16:17:02.850828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 191/361] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:03.260645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:03.269495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e2a317ea-c5da-4b0d-8757-de2c15355491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.818875 Sep 06 16:17:03.270077 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 171/362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:02 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:03.466222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:03.467186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:03.489688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.493917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.496010 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.497372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.498188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.498835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.635399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:03.636423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:03.652513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.655826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.656764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.659493 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:03.660180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:03.661910 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:03.785361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:03.799292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cede2e9b-3edb-4226-8ded-07bba83cf8c5 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1504 microversion: 2.1 time: 0.336033 Sep 06 16:17:03.800200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 192/363] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:03 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:04.150395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-48c0e162-4fd2-4676-bd91-039842b0d473 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Action: 'create', calling method: .version_select at 0x7f21b82ad9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1948053589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK2FdzfmzZ9rDpMf25CLdsg0fpIT25W+Bxsfc8RDbprtgypbl50HpIVf7QVVJ29hbHUkgSqFf+7Eddbz8uUVKkDNJco4PokfioqMz927uBXQzsF3noSiBzSrN/XMS7Ysg=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:04.166972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-48c0e162-4fd2-4676-bd91-039842b0d473 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Getting quotas for project fbc78793ec5c47aa9b56c6cbe6c4d9dc. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:17:04.171078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-48c0e162-4fd2-4676-bd91-039842b0d473 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Getting quotas for user ac26eb671f1a4a889e8d9c7c35a70019 and project fbc78793ec5c47aa9b56c6cbe6c4d9dc. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:17:04.205416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-48c0e162-4fd2-4676-bd91-039842b0d473 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058863 Sep 06 16:17:04.206494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 193/364] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:17:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:04.207547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.227845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ec466fe3-10f9-4b7f-87b2-8e83c4539da8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.596851 Sep 06 16:17:04.233210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-cf0ad94d-f747-4c62-9585-b8bf82c63b24 req-1b744628-24d3-45f9-ad64-c8e7493ae089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43c9441-d084-4b6b-9613-15998b512fbd", "name": "network-vif-deleted", "tag": "45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:04.235133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 172/365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:03 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:04.248923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cf0ad94d-f747-4c62-9585-b8bf82c63b24 req-1b744628-24d3-45f9-ad64-c8e7493ae089 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.249677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cf0ad94d-f747-4c62-9585-b8bf82c63b24 req-1b744628-24d3-45f9-ad64-c8e7493ae089 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.250408 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cf0ad94d-f747-4c62-9585-b8bf82c63b24 req-1b744628-24d3-45f9-ad64-c8e7493ae089 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.263269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-cf0ad94d-f747-4c62-9585-b8bf82c63b24 req-1b744628-24d3-45f9-ad64-c8e7493ae089 service nova] Creating event network-vif-deleted:45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2 for instance f43c9441-d084-4b6b-9613-15998b512fbd on hv-cinder-85220 Sep 06 16:17:04.269750 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-cf0ad94d-f747-4c62-9585-b8bf82c63b24 req-1b744628-24d3-45f9-ad64-c8e7493ae089 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039889 Sep 06 16:17:04.270851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 194/366] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:04.295330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:04.295954 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:04.302072 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.302570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.303064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.303773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.304238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.304668 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.334491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2051722692", "imageRef": "aea1b33a-4832-401c-80d1-d3265f7f43ce", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1948053589", "networks": [{"uuid": "137ac8ef-9af9-4e3f-ba78-bb9989355752"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:04.397058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] validate_networks() for [('137ac8ef-9af9-4e3f-ba78-bb9989355752', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:17:04.474308 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.483028 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1aa8272a-db32-4cd7-b321-d6eed4248f15 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.191643 Sep 06 16:17:04.494905 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 173/367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:04 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:04.818473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:17:04.818983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:17:04.819402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:17:04.819891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:17:04.820240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:17:04.827170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:04.828036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:04.830589 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.831237 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.831552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.832285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.832743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.833170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.836065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.836658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.837216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.838082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.838640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.839297 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.852365 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Getting quotas for project fbc78793ec5c47aa9b56c6cbe6c4d9dc. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:17:04.863955 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Getting quotas for user ac26eb671f1a4a889e8d9c7c35a70019 and project fbc78793ec5c47aa9b56c6cbe6c4d9dc. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:17:04.879029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:17:04.881384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aea1b33a-4832-401c-80d1-d3265f7f43ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:17:04.916626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:04.927512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ffe0c2e5-8f1f-442d-b925-72f61eb1a296 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1462 microversion: 2.1 time: 0.104121 Sep 06 16:17:04.933113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0ebbd623-2418-4152-966a-f17a3b20c605 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602616 Sep 06 16:17:04.940775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 195/368] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:17:04.944220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 174/369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:04 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1462 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:04.947633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b9fc323a-e020-4e9a-bfde-c9bba9790c78 req-9e37fd24-3e1a-47fc-b163-5a343995a1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43c9441-d084-4b6b-9613-15998b512fbd", "name": "network-vif-unplugged", "status": "completed", "tag": "45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:04.949423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3ead896b-816d-489a-ab1e-f0615f00090a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:04.950158 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3ead896b-816d-489a-ab1e-f0615f00090a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:04.963976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b9fc323a-e020-4e9a-bfde-c9bba9790c78 req-9e37fd24-3e1a-47fc-b163-5a343995a1c2 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:04.964640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b9fc323a-e020-4e9a-bfde-c9bba9790c78 req-9e37fd24-3e1a-47fc-b163-5a343995a1c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:04.966318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b9fc323a-e020-4e9a-bfde-c9bba9790c78 req-9e37fd24-3e1a-47fc-b163-5a343995a1c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:04.982878 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b9fc323a-e020-4e9a-bfde-c9bba9790c78 req-9e37fd24-3e1a-47fc-b163-5a343995a1c2 service nova] Creating event network-vif-unplugged:45aa33b2-4b6f-4e6b-a4ad-9abbfa97e6a2 for instance f43c9441-d084-4b6b-9613-15998b512fbd on hv-cinder-85220 Sep 06 16:17:05.002518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b9fc323a-e020-4e9a-bfde-c9bba9790c78 req-9e37fd24-3e1a-47fc-b163-5a343995a1c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056521 Sep 06 16:17:05.008934 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 196/370] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:05.031524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3ead896b-816d-489a-ab1e-f0615f00090a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:05.045252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3ead896b-816d-489a-ab1e-f0615f00090a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1259 microversion: 2.1 time: 0.099857 Sep 06 16:17:05.045917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 175/371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:04 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1259 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:05.260466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:05.261304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:05.270025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.270819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.271632 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.272620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.273379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.274175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.476060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:05.485855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-356906b5-afc8-4f4e-9f01-f406c54ccf5c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.230583 Sep 06 16:17:05.486462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 197/372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:05 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:05.507242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:05.507617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:05.513833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.514296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.514739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.515430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.516407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.517164 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.663836 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:05.680927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-45514413-2c53-4fad-8694-0feb3c543caa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.177962 Sep 06 16:17:05.681513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 176/373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:05 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:05.951230 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:05.951897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:05.958892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.959395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.959827 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:05.960522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:05.960970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:05.961383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.052479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:06.063554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cdb0fdba-cdf1-4a4d-a5ec-ac1bc3ffdda8 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1462 microversion: 2.1 time: 0.115503 Sep 06 16:17:06.064905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 198/374] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:05 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1462 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:06.073406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:06.074190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:06.083447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.083881 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.084671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.085785 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.086236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.086654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.156105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:06.159066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:06.168298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0d464256-ddb0-476b-bb21-58fab975dde8 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1263 microversion: 2.1 time: 0.098585 Sep 06 16:17:06.168878 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 177/375] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:06 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1263 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:06.510128 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:06.510894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:06.517897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.518382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.518864 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.519560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.520072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.520484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.677375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:06.685797 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2c5633c8-6162-4e88-822f-1e691794df30 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.179585 Sep 06 16:17:06.686585 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 199/376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:06 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:06.706555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:06.707192 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:06.713626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.714102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.714538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.715257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:06.715720 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:06.716134 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:06.861106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:06.869116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a9cff123-bc47-415a-822e-8b7ced6bd795 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.166780 Sep 06 16:17:06.869688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 178/377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:06 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:07.089442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:07.090088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:07.096745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.097231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.097665 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.098359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.098847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.099274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.161154 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.168815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a47b2044-65c1-466f-960b-89d8461e7c83 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1299 microversion: 2.1 time: 0.083314 Sep 06 16:17:07.169375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 200/378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:07 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:07.191234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:07.191851 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:07.197999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.198486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.198955 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.199655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.200132 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.200584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.265459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.274041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1a67b473-9e0b-45b9-bb76-cd911f15811a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1263 microversion: 2.1 time: 0.087248 Sep 06 16:17:07.274633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 179/379] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:07 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:07.713571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:07.714286 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:07.721338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.721827 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.722266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.723024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.723627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.723936 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.865070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:07.872998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fea1bd2c-cce3-40dd-858a-d045b16fd65b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.164402 Sep 06 16:17:07.873603 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 201/380] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:07 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:07.892814 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:07.893427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:07.900031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.900521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.900959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:07.901657 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:07.902171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:07.902600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.044339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.054412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ef589395-6dae-4238-b62c-aa5781774e79 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.165888 Sep 06 16:17:08.055032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 180/381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:07 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:08.192386 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:08.192926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:08.198951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.199432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.199869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.200554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.201008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.201430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.266564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.274274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d6e949e4-c7de-4842-a631-37acc6108119 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1299 microversion: 2.1 time: 0.086234 Sep 06 16:17:08.274866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 202/382] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:08 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:08.300060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:08.302589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:08.306891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.307381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.307822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.308518 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.308975 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.309402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.369758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:08.378125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d0533f1d-f4a5-4cbf-a704-972f4319d090 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1263 microversion: 2.1 time: 0.081973 Sep 06 16:17:08.378720 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 181/383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:08 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:08.896496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:08.897206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:08.905389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.905947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.906584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:08.907908 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:08.908583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:08.909074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.049240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.057527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ef3c768f-2d6b-47bf-ad2e-d831fedb65bb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.164886 Sep 06 16:17:09.058124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 203/384] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:08 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:09.080030 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:09.080623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:09.087500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.087994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.088425 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.089130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.089626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.090063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.250550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.259031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-03268d38-fa66-4d49-847e-fb50d31b76e7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.183156 Sep 06 16:17:09.259889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 182/385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:09 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:09.299370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:09.300027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:09.306463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.306985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.308229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.308229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.308928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.309229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.376383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.386190 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b3ee1ec3-a8f7-4627-a086-3877be608e38 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1299 microversion: 2.1 time: 0.091715 Sep 06 16:17:09.387171 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 204/386] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:09 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:09.404513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:09.405138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:09.412138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.412637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.413079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.413786 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:09.414243 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:09.414698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:09.482567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:09.490787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5dbb428a-b15c-46df-975b-8377947ddcc1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1263 microversion: 2.1 time: 0.090487 Sep 06 16:17:09.491372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 183/387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:09 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:10.082870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:10.083483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:10.089747 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.090234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.090698 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.091410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.091867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.092296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.240526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.253682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d2a6a974-0fe1-401c-933f-58b1dd1a5164 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.175036 Sep 06 16:17:10.254692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 205/388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:10 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:10.283266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:10.283886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:10.290753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.291253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.291730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.292441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.292900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.293329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.410513 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:10.412161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:10.420185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.420679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.421114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.421836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.422908 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.423303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.455679 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.464850 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b7d8f90a-b703-4572-8d91-2eb67e4c8a95 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.185426 Sep 06 16:17:10.465436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 184/389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:10 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:10.488968 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.492614 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:10.497794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b6b49fe0-e611-41ba-b1c4-e2adc801e888 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1299 microversion: 2.1 time: 0.091703 Sep 06 16:17:10.498392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 206/390] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:10 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:10.513538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:10.514304 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:10.520584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.521071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.521503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.522207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:10.522674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:10.523116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:10.589349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:10.597993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e62da444-eb16-4afd-91bd-9c81228c4054 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1263 microversion: 2.1 time: 0.088346 Sep 06 16:17:10.598585 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 185/391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:10 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:11.277688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.278211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.284980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.285475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.285916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.286676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.287139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.287572 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.436368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.445645 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5f462547-1519-47c5-ad04-d07d1f24352b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1501 microversion: 2.1 time: 0.172056 Sep 06 16:17:11.446233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 207/392] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:11.470822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4d9ccb2-35d2-4d25-a6b1-5e5f03e4741f"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:11.473315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.480051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.480535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.480964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.481662 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.482126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.482521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.489118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.489900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.497309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.498028 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.498842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.499733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.500794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.501409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.509914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] HTTP exception thrown: Cannot 'attach_volume' instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa while it is in vm_state rescued Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Request method failure captured: Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa/os-volume_attachments HTTP/1.1 Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 74 Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Hdgju97tQEPcRdHdLythvqGQSY2DsXgDVo-YwRbq86iiMwtEfs6p6WVIpgQQ8HXRst0XJLhtYylMq_O5tsHQdLVoaQvn0nvFuENdKxQ84q_KS_BHm6PtliV88UEis-RxvqrCTOwCt9tSKsl1IrIL-zmidECL4F0XaB00VFksv30dQ Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:17:11.511825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: eda6839efaab4317a0eda1f47f1656a2 Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {"volumeAttachment": {"volumeId": "c4d9ccb2-35d2-4d25-a6b1-5e5f03e4741f"}} Sep 06 16:17:11.514061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Cannot 'attach_volume' instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa while it is in vm_state rescued Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'server_id': 'e574f9ab-e5b1-4762-bf2e-211d8fd993fa', 'body': {'volumeAttachment': {'volumeId': 'c4d9ccb2-35d2-4d25-a6b1-5e5f03e4741f'}}} Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:11.515082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa while it is in vm_state rescued Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:11.516497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:11.518764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:11.518764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:11.518764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa while it is in vm_state rescued Sep 06 16:17:11.518764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:11.518764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Returning 409 to user: Cannot 'attach_volume' instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa while it is in vm_state rescued {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:11.518764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a843a142-8245-4354-acc7-d182e2c9df4c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047171 Sep 06 16:17:11.518764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 186/393] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:17:11 2022] POST /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 16:17:11.523551 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.524556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.530809 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.531616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.532176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.533076 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.533602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.534080 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.576517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.577125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.577651 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.578306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lazy-loading 'fault' on Instance uuid f43c9441-d084-4b6b-9613-15998b512fbd {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:17:11.624781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.633719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-30ca28d2-ab49-44e4-85cd-ef7deb78815a tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1304 microversion: 2.1 time: 0.113955 Sep 06 16:17:11.634343 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 187/394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:11.641758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:11.641758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.647120 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.647613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.648045 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.648753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.649199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.649618 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.652055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.661090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b50bcf33-83c0-4cd8-92b4-962f4d48027c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1361 microversion: 2.1 time: 0.176587 Sep 06 16:17:11.661682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 208/395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:11.666311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.666947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.673163 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.673889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.674483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.675402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.676016 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.676595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.736659 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-97f929e9-1254-43d5-bc28-c163ebb19b8f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa/action" status: 202 len: 0 microversion: 2.1 time: 0.101020 Sep 06 16:17:11.737312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 188/396] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:17:11 2022] POST /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:17:11.741920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.746931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:11.747708 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:11.750389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a1c496d3-9871-44d4-91fd-72e5f62720ed tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1255 microversion: 2.1 time: 0.087606 Sep 06 16:17:11.751100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 209/397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1255 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:11.755414 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.756585 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.757144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.758013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:11.758471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:11.758930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:11.909990 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:11.918439 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-97f84592-20e8-46b5-acca-92cdf83b0c8a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.176435 Sep 06 16:17:11.919071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 189/398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:11 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:12.005897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1232015273", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "networks": [{"uuid": "8141e3b1-e4bc-40fd-93bc-983288e8c8d3"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:12.072381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] validate_networks() for [('8141e3b1-e4bc-40fd-93bc-983288e8c8d3', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:17:12.662416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:12.664552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:12.676870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.677784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.678537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.682509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.683467 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.684160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.737145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.737677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.738088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.738547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lazy-loading 'fault' on Instance uuid f43c9441-d084-4b6b-9613-15998b512fbd {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:17:12.806102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:12.822923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-98fb086f-1987-4700-8c62-2ee23512ab20 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1304 microversion: 2.1 time: 0.167078 Sep 06 16:17:12.836279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 190/399] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:12 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:12.876125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:12.880420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:12.896939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:17:12.898915 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:17:12.900242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:17:12.901296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:17:12.901973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:17:12.907888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.908659 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.909463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.910830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.918380 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.920967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.921222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.922731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.923663 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.924802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:12.925819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:12.926922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:12.981197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Getting quotas for project 17e81ff9ac5c4468989eb31ba2130e0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:17:12.989103 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Getting quotas for user b266573c02ab476da327907dcfed5583 and project 17e81ff9ac5c4468989eb31ba2130e0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:17:13.005676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:17:13.008238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:17:13.076061 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-19a230d3-f675-487f-a4be-ca81a4fbd095 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073641 Sep 06 16:17:13.077628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 210/400] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:17:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:17:13.088045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:13.089368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:13.095777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:13.109470 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.110612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.111715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.112282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.113185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.113943 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.178673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.195177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-15228a84-b142-458b-b335-6212b120071b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1547 microversion: 2.1 time: 0.356603 Sep 06 16:17:13.196447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 191/401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:12 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1547 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:13.212639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:13.212639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:13.218617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.218889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.219736 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.220585 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.221867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.222751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.223631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.229995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-072df6b9-2b86-450c-9551-f40efe277488 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1255 microversion: 2.1 time: 0.150336 Sep 06 16:17:13.230972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 211/402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:13 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1255 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:13.238510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-22f9a29c-4977-4808-9fa8-94c7385c0db4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:13.239329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-22f9a29c-4977-4808-9fa8-94c7385c0db4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:13.333559 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-22f9a29c-4977-4808-9fa8-94c7385c0db4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.350457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-22f9a29c-4977-4808-9fa8-94c7385c0db4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1219 microversion: 2.1 time: 0.117754 Sep 06 16:17:13.352831 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 212/403] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:13 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:13.367475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:13.368393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:13.389018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.390264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.392100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.393183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.393951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.394906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.547589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:13.560344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b26a081e-e718-433c-93bd-c3e12b25e676 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.362213 Sep 06 16:17:13.580561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 192/404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:13 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:13.590216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-77d38e0e-1ab4-421f-a2f7-9a9a41cf8b03 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.235217 Sep 06 16:17:13.594284 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 213/405] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:17:13 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-interface => generated 285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:13.854747 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:13.856068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:13.870107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.871153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.874236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.877125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.878253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.879257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.889771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:13.942431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:13.943047 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:13.943547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:13.944093 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lazy-loading 'fault' on Instance uuid f43c9441-d084-4b6b-9613-15998b512fbd {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:17:14.002606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b24f1542cddf4fc9aa8003952e26cb96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f124871e909842f4b74ef9fb483f5dd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:14.018741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8679978d-b007-4c97-993c-c5ae944341d9 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 200 len: 1304 microversion: 2.1 time: 0.162556 Sep 06 16:17:14.018741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 193/406] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:13 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:14.282601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:14.283247 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:14.290492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.291022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.291694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.292844 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.293376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.294059 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.386112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:14.389181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:14.391660 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:14.403752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a64c7069-0096-49c3-aa0b-edd27ead45ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1311 microversion: 2.1 time: 0.125297 Sep 06 16:17:14.411597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 214/407] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:14 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:14.413795 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.415139 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.415939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.417013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.417662 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.418690 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.508867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:14.519462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6600a9ed-07d9-4183-9a4c-c80a75192cc1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1215 microversion: 2.1 time: 0.140781 Sep 06 16:17:14.522535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 194/408] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:14 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:14.601066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:14.602044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:14.610001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.610761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.613708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:14.615293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:14.615919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:14.616428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.000109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:15.008473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ca0dc68c-08ce-4782-b7db-4aa21e57cd40 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.411955 Sep 06 16:17:15.009342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 215/409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:14 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:15.035242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:15.036106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] [instance: f43c9441-d084-4b6b-9613-15998b512fbd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:15.042902 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:15.045417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.046005 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.046706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.047687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.048416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.049069 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.065626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] HTTP exception thrown: Instance f43c9441-d084-4b6b-9613-15998b512fbd could not be found. Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Request method failure captured: Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd HTTP/1.1 Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3INTfIByDBgDiQe06j_08IctkoKBT_NafrpfhYzZIvkmyMEiZGQxPnl0S38uHTGCejAJyGgb-41Zft4w6KlvT27FEWrM88MweZfZ6h0F7UEu583CYPX4h6Xw9gCEuG5ZeVX8POoPPFU-72iWff7TO4Ayix4gX3Rl7tmmlGVqOOhe0s Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: f124871e909842f4b74ef9fb483f5dd9 Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesActionsTest-1238362789 Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:17:15.067612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f124871e909842f4b74ef9fb483f5dd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesActionsTest-1238362789 Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: f124871e909842f4b74ef9fb483f5dd9 Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesActionsTest-1238362789 Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesActionsTest-1238362789-project Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: b24f1542cddf4fc9aa8003952e26cb96 Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesActionsTest-1238362789-project Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance f43c9441-d084-4b6b-9613-15998b512fbd could not be found. Sep 06 16:17:15.068886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': 'f43c9441-d084-4b6b-9613-15998b512fbd'} Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f43c9441-d084-4b6b-9613-15998b512fbd could not be found. Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:17:15.069581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f43c9441-d084-4b6b-9613-15998b512fbd could not be found. Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f43c9441-d084-4b6b-9613-15998b512fbd could not be found. Sep 06 16:17:15.070749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:17:15.074746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] Returning 404 to user: Instance f43c9441-d084-4b6b-9613-15998b512fbd could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:17:15.075821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-133e6a21-459b-4fe0-b6d1-7eae9a9d5a17 tempest-VolumesActionsTest-1238362789 tempest-VolumesActionsTest-1238362789-project] 10.222.0.26 "GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd" status: 404 len: 111 microversion: 2.1 time: 0.045088 Sep 06 16:17:15.076930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 195/410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:15 2022] GET /compute/v2.1/servers/f43c9441-d084-4b6b-9613-15998b512fbd => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:17:15.440962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:15.441974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:15.457153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.457592 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.458044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.458802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.459279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.459707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.548429 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:15.549067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:15.571369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.572228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.572877 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.573785 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:15.574253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:15.574740 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:15.602975 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:15.611997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ba317f8f-bdf1-4ac1-8fa7-2e78ecb2c7c2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1317 microversion: 2.1 time: 0.176765 Sep 06 16:17:15.614067 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 216/411] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:15 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:15.767586 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:15.778378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0ccb189a-fd6b-418d-95e0-6778b2e2da73 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1279 microversion: 2.1 time: 0.234272 Sep 06 16:17:15.790778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 196/412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:15 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:16.045081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:16.046016 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:16.056998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-51b35504-de7e-4c50-b910-75b4a1fa6240 req-e95b6922-728a-4a2c-a4de-ed6dab0cafd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d89aa26-192e-4016-93ea-772996bb9e49", "tag": "d1ec24f6-7663-4504-af80-9955a9372f97"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:16.073664 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.077407 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.077935 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.082438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.083082 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.083524 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.085674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-51b35504-de7e-4c50-b910-75b4a1fa6240 req-e95b6922-728a-4a2c-a4de-ed6dab0cafd1 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.086167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-51b35504-de7e-4c50-b910-75b4a1fa6240 req-e95b6922-728a-4a2c-a4de-ed6dab0cafd1 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.086609 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-51b35504-de7e-4c50-b910-75b4a1fa6240 req-e95b6922-728a-4a2c-a4de-ed6dab0cafd1 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.135600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-51b35504-de7e-4c50-b910-75b4a1fa6240 req-e95b6922-728a-4a2c-a4de-ed6dab0cafd1 service nova] Creating event network-changed:d1ec24f6-7663-4504-af80-9955a9372f97 for instance 1d89aa26-192e-4016-93ea-772996bb9e49 on hv-cinder-85220 Sep 06 16:17:16.147022 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-51b35504-de7e-4c50-b910-75b4a1fa6240 req-e95b6922-728a-4a2c-a4de-ed6dab0cafd1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090854 Sep 06 16:17:16.148000 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 197/413] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:16.621786 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:16.638776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:16.640007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:16.640543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-59ca1961-43e4-41ae-99db-0ed8c11e9b82 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.610578 Sep 06 16:17:16.644845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 217/414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:16 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:16.655034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.659164 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.659697 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.660501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.661008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.661478 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.820298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:16.821688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:16.843189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.847737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.848790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.850516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:16.851212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:16.851800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:16.984541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:16.998299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-05a680c9-3041-47ae-8775-ab8bf4c016f8 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1277 microversion: 2.1 time: 0.198193 Sep 06 16:17:17.010399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 218/415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:16 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:17.024309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:17.033494 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7432191d-899b-495c-9098-d4fef7de609c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.401344 Sep 06 16:17:17.035952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 198/416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:16 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:17.669274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:17.669977 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:17.677845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:17.678421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:17.678976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:17.679776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:17.680295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:17.680784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:17.889478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:17.898537 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-71e54a96-d8bf-4908-83d9-1f8fd820503c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.233774 Sep 06 16:17:17.899378 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 219/417] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:17 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:18.029795 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:18.032449 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:18.043840 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.045105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.045834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.047079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.047867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.048536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.066275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:18.066793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:18.073783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.074606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.075258 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.076139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.078886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.080900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.235567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:18.243673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e4df5962-5e2d-422d-861a-428bdd17e929 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.221194 Sep 06 16:17:18.250966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 199/418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:18 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:18.297972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:18.310708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6a81f7bc-98be-41c3-8a59-6b419d6e1749 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.250070 Sep 06 16:17:18.312072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 220/419] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:18 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:18.924157 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:18.925175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:18.931721 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.932216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.932649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:18.933405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:18.933855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:18.934277 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.078433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:19.086759 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3e791f34-508a-4c5b-a982-1981d36f66aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.167589 Sep 06 16:17:19.087283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 200/420] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:18 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:19.273418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:19.274552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:19.287184 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.288074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.288780 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.290018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.290869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.291639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.340014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:19.341234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:19.349959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.350464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.350952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.351833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:19.352407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:19.352845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:19.474160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:19.489822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-30513f64-0cda-4130-82ce-06a2f03c0f11 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.224509 Sep 06 16:17:19.490973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 221/421] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:19 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:19.506400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:19.514615 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6b04bef8-8dfd-4ab3-b4d8-47b8f8a8a9b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.182013 Sep 06 16:17:19.523213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 201/422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:19 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:20.111009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:20.112246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:20.119217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.119702 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.120139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.120840 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.121287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.121720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.268021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:20.276306 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-58e71fe6-4419-49d9-b43c-0e02528fb5a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.169162 Sep 06 16:17:20.276942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 222/423] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:20 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:20.532847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:20.533891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:20.542056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.542778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.543356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.544224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.545056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.545399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:20.545766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.546636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:20.557509 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.558265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.559162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.560464 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:20.561362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:20.562227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:20.712856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:20.722332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-85e459b9-9a76-4754-a100-f2e4f0c2d53f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.196690 Sep 06 16:17:20.723057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 202/424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:20 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:20.741571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:20.754545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-081681d5-37a8-4571-84c6-bea3c52b05c1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.217928 Sep 06 16:17:20.755218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 223/425] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:20 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:21.300801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:21.301331 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:21.307800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.308328 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.308769 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.309477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.309939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.310368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.451359 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:21.459624 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f1ceac27-41c2-4e88-b554-8cf62b891713 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.162821 Sep 06 16:17:21.460205 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 203/426] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:21 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:21.745664 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:21.746262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:21.753264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.753744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.754185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.754929 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.755377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.755909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.777675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:21.778397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:21.785882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.786369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.786839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.787543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:21.787996 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:21.788419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:21.904711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:21.920052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e6ebd651-3996-4b75-8b23-c8ba19191a03 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.178182 Sep 06 16:17:21.922410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 224/427] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:21 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:21.940737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:21.949965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dabe8f5e-667e-4dd0-bb7d-b0a3f3a8c78a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.176050 Sep 06 16:17:21.950613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 204/428] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:21 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:22.487439 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:22.488075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:22.494021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.494501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.494978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.495665 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.496117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.496539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.514554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:22.631060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:22.639245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-039be36f-e92a-4e0a-99c8-5f015efce481 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.155634 Sep 06 16:17:22.640060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 225/429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:22 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:22.948290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:22.949069 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:22.973509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.975937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.976679 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.977920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:22.980138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:22.981075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:22.984033 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:22.991715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:22.997675 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:23.022246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.023098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.023806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:23.030971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.032264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.033316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:23.337771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=18 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:23.376098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:23.401994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-746f7b68-66a3-4dc8-94e0-e73a8af2d798 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.430444 Sep 06 16:17:23.408802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 226/430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:22 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:23.443784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:23.472991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-edb83fe3-d437-472a-ba9b-eca1a485ab20 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.529760 Sep 06 16:17:23.485029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 205/431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:22 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:23.672228 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:23.673337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:23.713465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.714488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.715431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:23.716631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:23.717242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:23.735899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:23.969514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:23.987137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eb7470a2-1a50-4313-93a5-1d056b488e6c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.322278 Sep 06 16:17:24.003850 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 227/432] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:23 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:24.438516 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:24.440224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:24.443073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=96 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:24.457906 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:24.464926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:24.465378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:24.466138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:24.466602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:24.467212 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:24.512499 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:24.513115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:24.533595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:24.533914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:24.534694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:24.535724 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:24.536446 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:24.537039 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:24.737793 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:24.749231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-603b33d8-5122-40ec-addf-b395cf9d4916 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.315171 Sep 06 16:17:24.765340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 206/433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:24 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:24.776195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:24.787805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f25951d-0a66-409f-9e2a-699719766f70 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.279071 Sep 06 16:17:24.789033 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 228/434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:24 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:25.026876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:25.028146 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:25.056121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.056953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.057765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.059053 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.059884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.060671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.294798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:25.305371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8286bae6-b611-4175-9f08-d12f54c5e05c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.286202 Sep 06 16:17:25.305968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 207/435] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:25 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:25.777408 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:25.778180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:25.784816 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.785418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.785929 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.786771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.787308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.787826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.823756 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:25.824367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:25.837699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.838586 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.839333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.840600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:25.841291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:25.841940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:25.981160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:25.991505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c38304b5-8452-4b78-882d-609fda7659ba tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.217733 Sep 06 16:17:25.992852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 229/436] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:25 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:26.087173 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:26.097247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fc69bbb9-1fcf-421a-a699-28e09743995f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.277456 Sep 06 16:17:26.097862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 208/437] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:25 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:26.339889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:26.341486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:26.354022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:26.354527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:26.355011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:26.355743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:26.356209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:26.356638 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:26.582557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:26.609090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fd00202f-217f-4067-beef-ef86cbc34baf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.274637 Sep 06 16:17:26.610759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 230/438] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:26 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:27.023982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:27.025583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:27.034967 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.035713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.036229 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.037023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.037556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.038062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.121911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:27.122551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:27.130776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.130776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.131092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.131776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.132238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.132665 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.217866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:27.235868 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-be2a8a17-f9b9-4aea-9b1c-e31874013460 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.215755 Sep 06 16:17:27.236765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 209/439] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:27 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:27.286417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:27.294922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8d3a53ca-e1d9-49b4-bdc9-4a2ba64610bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.177548 Sep 06 16:17:27.311022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 231/440] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:27 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:27.640725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:27.642247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:27.649630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.650276 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.650814 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.651573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:27.652095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:27.652592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:27.823981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:27.827801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:27.838386 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-de375cce-22d8-4d50-a0d9-3d2acf268973 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.201308 Sep 06 16:17:27.839483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 210/441] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:27 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:28.261896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:28.263311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:28.270744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.271638 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.272311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.273310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.273880 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.274481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.319542 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:28.321431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:28.330376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.331718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.343416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.346419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.347682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.349775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.514242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:28.531800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6719ef20-7bc2-45c1-b4ab-9daefab3ff59 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.272460 Sep 06 16:17:28.547735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 232/442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:28 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:28.573547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:28.583592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3b9d6b71-1dcb-450d-855c-4350d6658321 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.269152 Sep 06 16:17:28.584843 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 211/443] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:28 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:28.870018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:28.871367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:28.881999 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.883852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.883852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:28.886360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:28.886360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:28.886360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.143466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:29.152233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f1543597-7cff-4869-adad-17d784e1c48b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.288216 Sep 06 16:17:29.152819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 233/444] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:28 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:29.582382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:29.583372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:29.592528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.593251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.595339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.601359 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.601936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.602465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.621459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:29.622053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:29.629617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.630722 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.631552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.632583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:29.633631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:29.634296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:29.752261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:29.761852 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fb9ddd0d-561a-47a2-81a6-538b06bd815b tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.184013 Sep 06 16:17:29.762548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 212/445] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:29 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:29.845426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:29.872447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-75874654-cec0-42c4-aff0-e3af9f4a0e8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.254937 Sep 06 16:17:29.874960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 234/446] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:29 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:30.177509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:30.178515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:30.189081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.191696 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.191696 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.192774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.193406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.194270 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.366433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:30.377886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fa67b9c6-44cb-4270-b177-d2462fb96fe9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1509 microversion: 2.1 time: 0.204085 Sep 06 16:17:30.397521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 213/447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:30 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:30.788193 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:30.789502 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:30.809992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.813564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.815735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.816507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.816973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.817410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.898034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:30.898979 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:30.916723 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.917274 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.917745 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:30.918510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:30.918997 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:30.919500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:31.009050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:31.018457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0de649e6-09d5-486e-9ae9-3c59405b07b4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.234381 Sep 06 16:17:31.030722 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 235/448] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:30 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:31.148476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:31.158469 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c85a0b69-1c64-4261-94ec-28cd38d6eead tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.264209 Sep 06 16:17:31.159609 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 214/449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:30 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:31.422375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:31.423415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:31.435805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:31.436412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:31.436910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:31.441771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:31.442376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:31.442927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:31.747971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:31.768175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c6d26284-367a-4307-a129-de6f0edace0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1515 microversion: 2.1 time: 0.350448 Sep 06 16:17:31.775138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 236/450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:31 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:32.070148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:32.071561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:32.078213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:32.095463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:32.096327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:32.097307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:32.097982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:32.098634 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:32.190273 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:32.191531 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:32.199296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:32.200224 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:32.200990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:32.202418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:32.204608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:32.205798 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:32.449367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:32.462928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b5bdd5bf-52cf-4f36-9ebc-35431217043d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.277888 Sep 06 16:17:32.471949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 237/451] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:32 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:32.504436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:32.520707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9919008d-56d4-418f-94d9-e0be7f16596a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.454806 Sep 06 16:17:32.526178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 215/452] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:32 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:33.507301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:33.508032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:33.544586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.545494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.551793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.553178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.553902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.556140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.561563 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:33.563186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:33.591757 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.592250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.592714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.602822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:33.604930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:33.608357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:33.776594 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:33.791114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-96be0af2-f881-48cb-813d-f1470db68731 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.291046 Sep 06 16:17:33.792761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 238/453] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:33 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:34.022515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:34.033498 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cb6368c3-2fbb-48e4-b9e5-ce0b8a8483cd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.479913 Sep 06 16:17:34.034816 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 216/454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:33 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:34.841208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:34.843336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:34.850977 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:34.851704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:34.852356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:34.853501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:34.854178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:34.854831 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:34.917952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8f6dcd9a-6d68-4119-8847-0fbf69590274 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'create', calling method: .version_select at 0x7f21b91b8d30>, body: {"keypair": {"name": "tempest-keypair-98580497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNAgehTbeAw06vJR4YlPzTKDHki9MP9tnu1D8NnCdRzmOGr3WL87jCdZmy6hKljQo/zkSLTr75Oz8hTcqxPZSTXMFxRS4Jb1q5GKVwll0JMcIGxab09kcIBi5GLpgwSJQ=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:34.943347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-8f6dcd9a-6d68-4119-8847-0fbf69590274 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:17:34.959879 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-8f6dcd9a-6d68-4119-8847-0fbf69590274 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for user eda6839efaab4317a0eda1f47f1656a2 and project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:17:34.992776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f6dcd9a-6d68-4119-8847-0fbf69590274 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [a9de8851-eae2-4ee3-8f0f-920de880952d] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 16:17:35.088661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:35.099318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-776bfa27-09d5-4532-954c-c575f087d965 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.277565 Sep 06 16:17:35.120701 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 239/455] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:34 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:35.128888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:35.129872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:35.137807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:35.138680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:35.139375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:35.141750 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:35.142593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:35.143509 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:35.490325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:35.521709 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-719df15d-c9a4-43e7-8464-b9c69c6a2cab tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.398750 Sep 06 16:17:35.524703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 240/456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:35 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:36.010014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f6dcd9a-6d68-4119-8847-0fbf69590274 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [a9de8851-eae2-4ee3-8f0f-920de880952d] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37072. Sep 06 16:17:36.061103 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8f6dcd9a-6d68-4119-8847-0fbf69590274 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.148406 Sep 06 16:17:36.066792 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 217/457] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:17:34 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:36.129972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:36.131157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:36.145644 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:36.146558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:36.148395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:36.149361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:36.152132 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:36.152810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:36.549056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:36.550405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:36.569344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:36.570137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:36.572850 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:36.573948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:36.577305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:36.577789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:36.678480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:36.701834 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dbffe86b-af77-448f-b2ae-cc3649684d08 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.575607 Sep 06 16:17:36.703646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 241/458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:36 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:37.013027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:37.024583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4bb26fda-540f-4679-8dbc-ae3dc84d6b5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.482125 Sep 06 16:17:37.043401 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 218/459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:36 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:37.731916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:37.733353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:37.753669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:37.756440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:37.759783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:37.760684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:37.761711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:37.762217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:37.774779 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:38.052509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:38.053186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:38.066432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.068302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.071859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:38.072892 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:38.073524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:38.075510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:38.373597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:38.401972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d249ef75-cf0a-4a73-9441-c1e53ad6a645 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.672222 Sep 06 16:17:38.419351 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 242/460] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:37 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:38.518116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:38.530557 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ef8af8ea-bfdc-476a-83b7-c53c501820a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.484669 Sep 06 16:17:38.535516 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 219/461] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:38 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:39.127955 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-aee60b64-252f-422e-8b4d-86c6136d0e65 req-387fad3e-f81f-4598-8d35-8e73bfdfa603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3671dc8-5c23-42c5-94b6-572742974ed9", "tag": "42495ad5-bd8b-4c9f-917a-9fda7028838e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:39.201253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-aee60b64-252f-422e-8b4d-86c6136d0e65 req-387fad3e-f81f-4598-8d35-8e73bfdfa603 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:39.206847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-aee60b64-252f-422e-8b4d-86c6136d0e65 req-387fad3e-f81f-4598-8d35-8e73bfdfa603 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:39.209036 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-aee60b64-252f-422e-8b4d-86c6136d0e65 req-387fad3e-f81f-4598-8d35-8e73bfdfa603 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:39.283409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-aee60b64-252f-422e-8b4d-86c6136d0e65 req-387fad3e-f81f-4598-8d35-8e73bfdfa603 service nova] Creating event network-changed:42495ad5-bd8b-4c9f-917a-9fda7028838e for instance e3671dc8-5c23-42c5-94b6-572742974ed9 on hv-cinder-85220 Sep 06 16:17:39.315853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-aee60b64-252f-422e-8b4d-86c6136d0e65 req-387fad3e-f81f-4598-8d35-8e73bfdfa603 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196233 Sep 06 16:17:39.331470 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 243/462] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:39.442025 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:39.444100 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:39.466608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:39.471884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:39.474370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:39.480136 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:39.481296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:39.483826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:39.586004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:39.592673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:39.641214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:39.651214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:39.653174 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:39.654578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:39.663242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:39.670708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:40.585148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:40.610638 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-536e3384-3832-484a-93f9-91eaf979f038 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 1.030360 Sep 06 16:17:40.611551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 244/463] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:39 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:41.494780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:41.521658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eb4eda85-a55a-49b3-bc1b-3fe84289c8af tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 2.092003 Sep 06 16:17:41.544136 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 220/464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:39 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:41.642088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:41.643577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:41.676307 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:41.680990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:41.682008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:41.695183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:41.697158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:41.698653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.006514 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-83b4102d-a89a-4cb6-9c62-07e275775ea4 req-ac034b62-b3b5-46e3-8d7d-bca4cad2b005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c69f8-26fd-4b9a-900d-11a0dc0e22b8", "tag": "602703ac-73bc-4d76-8d30-7fc671f1225e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:42.029292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-83b4102d-a89a-4cb6-9c62-07e275775ea4 req-ac034b62-b3b5-46e3-8d7d-bca4cad2b005 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:42.030690 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-83b4102d-a89a-4cb6-9c62-07e275775ea4 req-ac034b62-b3b5-46e3-8d7d-bca4cad2b005 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:42.033261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-83b4102d-a89a-4cb6-9c62-07e275775ea4 req-ac034b62-b3b5-46e3-8d7d-bca4cad2b005 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.061951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-83b4102d-a89a-4cb6-9c62-07e275775ea4 req-ac034b62-b3b5-46e3-8d7d-bca4cad2b005 service nova] Creating event network-changed:602703ac-73bc-4d76-8d30-7fc671f1225e for instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 on hv-cinder-85220 Sep 06 16:17:42.082864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-83b4102d-a89a-4cb6-9c62-07e275775ea4 req-ac034b62-b3b5-46e3-8d7d-bca4cad2b005 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078172 Sep 06 16:17:42.085472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 221/465] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:42.592306 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:42.593279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:42.593279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:42.653666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:42.658210 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:42.659882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.661332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:42.661708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aa6f5db7-2c6e-4335-82f2-fa8de22e51f6 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 1.012759 Sep 06 16:17:42.666454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:42.667467 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:42.670221 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 245/466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:41 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:43.384437 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:43.397724 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bad4415b-6136-44b9-88bc-a7d5141ae011 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.830826 Sep 06 16:17:43.410693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 222/467] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:42 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:43.714838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:43.715459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:43.730315 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=72 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:43.732464 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:43.734262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:43.734916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:43.740250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-928063160", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18191309-c07b-4655-99ce-5637e61da145"}], "security_groups": [{"name": "tempest-securitygroup--1273034569"}], "key_name": "tempest-keypair-98580497", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:43.743982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:43.745318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:43.747105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:44.043680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] validate_networks() for [('18191309-c07b-4655-99ce-5637e61da145', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:17:44.121959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:44.132150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0f813c5a-1fb7-4847-a3b0-46899578e157 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.425224 Sep 06 16:17:44.133130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 246/468] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:43 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:44.425639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:44.428187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:44.454100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:44.462546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:44.464577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:44.470879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:44.471801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:44.472475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:44.751506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:44.766213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7569a565-d40f-4fa2-9c65-3e8b9d730dda tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.345430 Sep 06 16:17:44.789104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 247/469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:44 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:44.973054 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=4 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:45.162973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:45.165346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:45.179442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.180289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.180955 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.186045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.190485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.192238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.374465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:17:45.376403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:17:45.377191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:17:45.377823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:17:45.378400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:17:45.389709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.393422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.396493 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.397527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.398101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.398621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.430258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:17:45.435914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Getting quotas for user eda6839efaab4317a0eda1f47f1656a2 and project 6d1e05e9e4a940e78a43d397f0c0db16. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:17:45.457796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:17:45.465129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:17:45.514497 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:45.525549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [9153bfea-a5fe-4038-9be3-2823c372e34e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 16:17:45.526440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ac69e593-db09-4c25-b7c8-f5cdc2564211 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.370076 Sep 06 16:17:45.533018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 248/470] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:45 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:45.798699 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:45.800127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:45.809260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.809818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.810258 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:45.811996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:45.812690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:45.813345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:46.118590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:46.130863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cfc33ca7-63e4-4f6e-b29c-932624cdf697 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.337310 Sep 06 16:17:46.133066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 249/471] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:45 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:46.539708 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [9153bfea-a5fe-4038-9be3-2823c372e34e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37300. Sep 06 16:17:46.556092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e1ccf01c-3d66-4c23-b69e-671219270dd1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.821270 Sep 06 16:17:46.559987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 223/472] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:17:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 2826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 16:17:46.577915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c2c27a5c-c3fc-41a9-8950-f7b20caf0477 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:46.580126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c2c27a5c-c3fc-41a9-8950-f7b20caf0477 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:46.590956 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:46.594013 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:46.619374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:46.620221 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:46.621023 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:46.623465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:46.624261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:46.625543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:46.730220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c2c27a5c-c3fc-41a9-8950-f7b20caf0477 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:46.753874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c2c27a5c-c3fc-41a9-8950-f7b20caf0477 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1243 microversion: 2.1 time: 0.178047 Sep 06 16:17:46.758026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 224/473] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:46 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1243 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:46.932471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:46.942105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3e4f70d0-9843-4903-bdc1-c8bc204bbad2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.389736 Sep 06 16:17:46.944327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 250/474] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:46 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:47.176224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:47.177036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:47.196928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.197428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.199699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.200653 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.202200 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.204225 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.810280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:47.813050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:47.829687 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.830215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.831718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.836204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.837646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.838343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.919244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:47.932142 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3424c2cb-a601-4629-9f29-7a725ac3abb9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.763402 Sep 06 16:17:47.933730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 225/475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:47 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:47.973443 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:47.978008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:47.991735 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.992605 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.994339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:47.996070 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:47.996838 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:47.997580 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:48.078951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:48.114593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d5e9ddc6-de19-47b0-a366-fc96bfa7cde1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1295 microversion: 2.1 time: 0.313858 Sep 06 16:17:48.117384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 251/476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:47 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1295 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:48.384254 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:48.394803 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f113db1e-2bf5-4810-8df4-8026bf31c86c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.430810 Sep 06 16:17:48.395488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 226/477] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:47 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:48.961510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:48.962121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:48.978478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:48.981041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:48.981836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:48.984706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:48.987843 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:48.989073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:49.145496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:49.146817 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:49.160148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:49.161301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:49.162161 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:49.163226 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:49.164756 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:49.166026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:49.294389 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:49.327075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e3c12c6c-53f6-462d-81ad-8abc09ea0b67 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1295 microversion: 2.1 time: 0.177719 Sep 06 16:17:49.327075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 227/478] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:49 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1295 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:49.420366 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:49.421390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:49.428973 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:49.430086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:49.430841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:49.432573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:49.433597 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:49.434689 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:49.444625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:49.457031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a31cc738-d1c0-4bf3-9708-6c1864570244 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.499110 Sep 06 16:17:49.461362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 252/479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:48 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:49.780575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:49.791411 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ddf2fcbf-4d0d-4ada-8cb8-e888d64d6cde tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.375154 Sep 06 16:17:49.803149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 228/480] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:49 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:50.379299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:50.380821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:50.396935 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.397695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.398294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.399867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.400532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.401163 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.541058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:50.544558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:50.547994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:50.556931 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6a32ff5f-909f-4aea-af36-df71da7dd5bd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1295 microversion: 2.1 time: 0.191961 Sep 06 16:17:50.565416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.566502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.567330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.568895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.574633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.576044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.581480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 253/481] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:50 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1295 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:50.820373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:50.821321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:50.840232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.840909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.842119 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.844135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:50.845301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:50.846189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:50.954912 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:50.973741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9e2e3d82-c043-41b9-a665-0f6bedc01eac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.448129 Sep 06 16:17:50.973741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 229/482] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:50 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:51.173651 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:51.182785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f2d1eb9-0c02-4e30-bdbd-981a7045aa2d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.369075 Sep 06 16:17:51.196649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 254/483] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:50 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:51.595360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:51.603704 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:51.612611 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:51.614064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:51.615233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:51.616276 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:51.617505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:51.618568 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:51.759657 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:51.763218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:51.776909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c1ab96ff-d1de-4b07-9682-268a777cd1a2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1295 microversion: 2.1 time: 0.195739 Sep 06 16:17:51.778497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 230/484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:51 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:52.009726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:52.011139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:52.019802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:52.021067 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:52.021801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:52.022561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:52.023076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:52.023683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:52.211971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:52.212354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:52.213248 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:52.221042 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:52.221939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-024fca0c-0a42-43c4-b08c-c2af31b00aaf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.215345 Sep 06 16:17:52.222450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:52.222990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 255/485] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:52 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:52.223428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:52.224218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:52.224690 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:52.225126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:52.445307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:52.454849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aaefeef6-371b-422e-b197-7130c1e246b0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.246359 Sep 06 16:17:52.466843 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 231/486] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:52 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:52.810849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:52.811868 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:52.824716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:52.825746 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:52.826486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:52.827894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:52.829207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:52.830909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:52.941331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:52.949927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0bef8b9f-ba1c-4524-bc7a-14fa74426d20 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1295 microversion: 2.1 time: 0.146267 Sep 06 16:17:52.950835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 256/487] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:52 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:53.251191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:53.251950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:53.260838 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.261356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.262079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:53.262875 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.263427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.263855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:53.446931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:53.464599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9b6f0113-0718-42c4-80a8-655d583873d2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.219886 Sep 06 16:17:53.466647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 232/488] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:53 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:53.496274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:53.498689 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:53.510730 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.512084 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.512980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:53.514336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.516679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.517109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:53.776478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:53.794966 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fe2424d9-00c7-4bce-aba5-2f5d734debbd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.307198 Sep 06 16:17:53.796209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 257/489] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:53 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:53.977161 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:53.978156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:53.987870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.988859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.989626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:53.990921 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:53.991618 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:53.992360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:54.340406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:54.368435 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aeea0bf5-0919-4622-8b63-3e9db21a913f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1295 microversion: 2.1 time: 0.395863 Sep 06 16:17:54.369392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 233/490] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:53 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1295 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:54.497477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:54.499631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:54.514392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:54.517006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:54.517799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:54.518891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:54.519770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:54.520546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:54.837324 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:54.838043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:54.840316 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:54.852414 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:54.853373 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:54.856504 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:54.857547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:54.864212 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:54.865098 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:54.948990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:54.960486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a2296fa-df7a-4395-8206-46de6b4be575 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.472774 Sep 06 16:17:54.961477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 258/491] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:54 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:55.296333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:55.332191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7ebfade9-76c5-4aff-9eb1-752b128ac738 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.494486 Sep 06 16:17:55.368126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 234/492] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:54 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:17:55.405061 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:55.406768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:55.426220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:55.428029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:55.428849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:55.434629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:55.436698 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:55.437931 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:55.492458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:55.626017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:55.656985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e6320f31-c889-4959-8d63-646dd9bd5d3b tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1303 microversion: 2.1 time: 0.259450 Sep 06 16:17:55.660400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 259/493] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:55 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:55.987312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:55.988178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:55.994543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:55.996388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.003072 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.005146 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.006238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.006970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.007636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.375527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:56.376142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:56.387207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.389718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.396120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.397042 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.397637 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.398429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.670193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:56.688900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:56.700247 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-136e6010-3947-4ac0-bc26-1a82f817bf3e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.329268 Sep 06 16:17:56.701487 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 260/494] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:56 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:56.702342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1038f956-a985-4a8f-98b5-74c7918bea4e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.719738 Sep 06 16:17:56.703842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 235/495] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:55 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:56.718979 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:56.720165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:56.726519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.727371 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.728030 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.728983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:56.729649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:56.730456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:56.818075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:56.829693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f8f30071-3beb-4513-8e86-90e14e9d57a8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1303 microversion: 2.1 time: 0.125852 Sep 06 16:17:56.830350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 261/496] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:56 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:57.743247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:57.744972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:57.752779 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=8 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:17:57.756044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.756895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.758069 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:57.758742 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.759648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.760307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:57.816209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:57.817660 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:57.832819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.833723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.834762 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:57.835769 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:57.840821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:57.844567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:58.004016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:58.012656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0cd13f22-cfb6-4445-ba75-6bd370dbebdd tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.275352 Sep 06 16:17:58.013257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 236/497] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:57 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:58.023148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:58.023778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:58.045757 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:58.046529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:58.047153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:58.048039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:58.048501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:58.048981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:58.147732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:58.159776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8607cd7d-d21d-4a73-81b3-d306e623f819 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1303 microversion: 2.1 time: 0.145194 Sep 06 16:17:58.181062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 237/498] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:58 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:58.186847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:58.199113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dc903b2e-731b-4d71-9bbf-a57f55524a14 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.388848 Sep 06 16:17:58.201547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 262/499] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:57 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:59.036445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:59.037069 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:59.044464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.045295 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.045734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.047176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.047794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.048403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.238488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:59.258800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e948fb27-8d66-493f-b0af-b1a1cc5f5a36 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.221399 Sep 06 16:17:59.259940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 238/500] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:59 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:59.269104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:59.286841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:59.300815 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.301416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.301761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.303075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.309519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.309984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.406999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:59.422381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c6077b83-fdd2-4aa5-b25d-7f9e8ef2cb62 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1303 microversion: 2.1 time: 0.160847 Sep 06 16:17:59.425497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 239/501] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:59 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:17:59.450025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1caab599-a32b-4f4e-8108-ec6e8a57fd12 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Action: 'create', calling method: .version_select at 0x7f21b83d53a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-357680795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzjgD16R4704GtzboTZxUnDcUgR5zTuSSi5mKF1bOwqpEfA3RF1bM/kOedbjsWWfWVtsJCb5cOvkky4oZ6Md1xJHWxFB8jI71zF1kBdIncn9Di2hQMApzRTtq9twAxFpw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:59.455122 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:17:59.455843 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:17:59.465816 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.466246 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.466706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.467644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.468095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.469810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.481446 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-1caab599-a32b-4f4e-8108-ec6e8a57fd12 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Getting quotas for project abf281d8694e486da6d616fe43107474. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:17:59.487563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-1caab599-a32b-4f4e-8108-ec6e8a57fd12 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Getting quotas for user e0eaab966616458592a89cdef9cf63c3 and project abf281d8694e486da6d616fe43107474. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:17:59.518560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1caab599-a32b-4f4e-8108-ec6e8a57fd12 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.397740 Sep 06 16:17:59.520323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 263/502] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:17:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:17:59.585099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-0b1da025-b262-4b73-812c-1633b40df34c req-0cf152f8-406e-41ad-b48c-ac32ef1085c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3671dc8-5c23-42c5-94b6-572742974ed9", "name": "network-vif-plugged", "status": "completed", "tag": "42495ad5-bd8b-4c9f-917a-9fda7028838e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:17:59.619180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0b1da025-b262-4b73-812c-1633b40df34c req-0cf152f8-406e-41ad-b48c-ac32ef1085c2 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:17:59.619669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0b1da025-b262-4b73-812c-1633b40df34c req-0cf152f8-406e-41ad-b48c-ac32ef1085c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:17:59.620102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0b1da025-b262-4b73-812c-1633b40df34c req-0cf152f8-406e-41ad-b48c-ac32ef1085c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:17:59.654566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-0b1da025-b262-4b73-812c-1633b40df34c req-0cf152f8-406e-41ad-b48c-ac32ef1085c2 service nova] Creating event network-vif-plugged:42495ad5-bd8b-4c9f-917a-9fda7028838e for instance e3671dc8-5c23-42c5-94b6-572742974ed9 on hv-cinder-85220 Sep 06 16:17:59.667583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-0b1da025-b262-4b73-812c-1633b40df34c req-0cf152f8-406e-41ad-b48c-ac32ef1085c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087656 Sep 06 16:17:59.668458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 264/503] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:17:59.685608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:17:59.705357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8bacab01-cb99-4b6e-84fa-20362428931f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.265245 Sep 06 16:17:59.706025 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 240/504] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:17:59 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:00.301033 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:00.301737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:00.314226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.315025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.315867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.316420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.317029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.317979 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.455347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:00.457526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:00.465739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.466885 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.467407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.468260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.469367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.469993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.529896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:00.541322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-302e1954-3e91-4b9a-a139-ae72750e6a56 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.244573 Sep 06 16:18:00.541914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 265/505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:00 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:00.554425 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:00.570286 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-81efaa3b-617b-455b-9340-09e5c463b5b0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1303 microversion: 2.1 time: 0.122041 Sep 06 16:18:00.571990 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 241/506] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:00 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:00.732010 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:00.732657 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:00.739855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.740385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.740860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.741695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:00.742162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:00.742973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:00.959627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:00.968269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c15ed976-cdc8-43b1-a782-649f6c691586 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.240083 Sep 06 16:18:00.970017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 266/507] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:00 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:01.573338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:01.575004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:01.583315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.583919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.584627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.585343 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.585800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.586223 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.603108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:01.604716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:01.612138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.613785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.614646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.615568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:01.616352 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:01.616975 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:01.696714 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:01.704732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dced0c96-c7e2-4f38-8a97-a50303dad4d3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1303 microversion: 2.1 time: 0.113281 Sep 06 16:18:01.705321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 267/508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:01 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:01.762171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:01.770648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c17ba341-ff80-4ffa-844b-5e18e9f2fe3a tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.201726 Sep 06 16:18:01.771348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 242/509] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:01 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:01.993935 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:01.994570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:02.011574 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.011992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.012775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.017235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.017809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.018254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.264758 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:02.273346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5e122c11-372f-4247-9efd-641d2a3bf667 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.283477 Sep 06 16:18:02.274061 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 268/510] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:01 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:02.728298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:02.731085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:02.738823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.739309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.739744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.740508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.740953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.741378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.794884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:02.795501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:02.802791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.803563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.804158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.805017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:02.805617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:02.806188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:02.819050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:02.829388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-be559b35-f93d-4bfc-9a60-ac2a876292a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1301 microversion: 2.1 time: 0.105221 Sep 06 16:18:02.849551 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 243/511] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:02 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:02.957183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:02.964884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d50a7fbd-144f-4ec8-a7cb-94c1a4b01eac tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.175162 Sep 06 16:18:02.965535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 269/512] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:02 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:03.300037 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:03.301306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:03.308486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:03.309064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:03.309503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:03.310267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:03.313652 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:03.314136 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:03.522431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:03.532640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7aadbae5-0d67-48bc-a32f-06e458fbcbf9 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.238278 Sep 06 16:18:03.533404 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 244/513] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:03 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:03.857145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:03.857759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:03.865817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:03.866572 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:03.867072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:03.867967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:03.869088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:03.869971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:03.990267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:03.991083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:03.998787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:04.000020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:04.000559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:04.001559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:04.002291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:04.003024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:04.094888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:04.105756 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0183c668-90a2-40ea-bb06-94dab85d3f23 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.252489 Sep 06 16:18:04.110448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 270/514] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:03 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:04.251271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:04.263823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0350f89e-1790-4ef3-87aa-750c409b1ab3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.277829 Sep 06 16:18:04.267386 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 245/515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:03 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:04.560307 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:04.561510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:04.574972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:04.575671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:04.576325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:04.577327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:04.578384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:04.579011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:04.745982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:04.755313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9c3bd24a-dc8d-4b05-aebb-f56365934808 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.202513 Sep 06 16:18:04.755833 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 271/516] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:04 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:05.130450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:05.131110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:05.137909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.138400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.138881 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.139618 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.140745 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.141174 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.278302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:05.286372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fb25f705-95fb-4d3f-a68f-9e03cfa1c9ee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.160134 Sep 06 16:18:05.287305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 246/517] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:05 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:05.290730 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:05.291720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:05.297723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.298211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.298642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.299353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.299795 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.300211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.451232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:05.460278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-52f01493-86d3-4cfc-bfbe-fd1a8cb42fa0 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.173445 Sep 06 16:18:05.460863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 272/518] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:05 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:05.778966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:05.779715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:05.787072 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.787642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.788240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.789071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:05.789538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:05.790117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:05.810820 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:06.042778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:06.067080 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4b6bd867-7247-4a12-b634-784f08694549 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1319 microversion: 2.1 time: 0.290269 Sep 06 16:18:06.068036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 247/519] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:05 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:06.144163 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-027481a8-f5d4-4547-af38-9ab05fed2899 req-ce1f3c8c-13c0-417a-88a9-350e29535ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570c69f8-26fd-4b9a-900d-11a0dc0e22b8", "name": "network-vif-plugged", "status": "completed", "tag": "602703ac-73bc-4d76-8d30-7fc671f1225e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:06.155285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-027481a8-f5d4-4547-af38-9ab05fed2899 req-ce1f3c8c-13c0-417a-88a9-350e29535ad6 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.156643 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-027481a8-f5d4-4547-af38-9ab05fed2899 req-ce1f3c8c-13c0-417a-88a9-350e29535ad6 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.157209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-027481a8-f5d4-4547-af38-9ab05fed2899 req-ce1f3c8c-13c0-417a-88a9-350e29535ad6 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.170330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-027481a8-f5d4-4547-af38-9ab05fed2899 req-ce1f3c8c-13c0-417a-88a9-350e29535ad6 service nova] Creating event network-vif-plugged:602703ac-73bc-4d76-8d30-7fc671f1225e for instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 on hv-cinder-85220 Sep 06 16:18:06.175912 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-027481a8-f5d4-4547-af38-9ab05fed2899 req-ce1f3c8c-13c0-417a-88a9-350e29535ad6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037615 Sep 06 16:18:06.177158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 273/520] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:06.314989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:06.315928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:06.338097 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.339109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.339631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.340413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.341076 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.341616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.484333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:06.485198 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:06.491335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.492270 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.492706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.493639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.494099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.494528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.545426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:06.554222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-38b35779-0750-4287-ac43-5cc57f4778d9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.248231 Sep 06 16:18:06.555496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 248/521] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:06 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:06.575240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-fe4f4055-3869-402d-8ada-ff99b9101186 req-e056cd6e-5535-4efd-a442-7a281bce7cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabc80db-90dc-4ac2-85a4-d86a4e2506e3", "tag": "1c51f956-0113-45f5-b6b4-fe6b787d4b5a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:06.586627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-fe4f4055-3869-402d-8ada-ff99b9101186 req-e056cd6e-5535-4efd-a442-7a281bce7cb7 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:06.587442 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-fe4f4055-3869-402d-8ada-ff99b9101186 req-e056cd6e-5535-4efd-a442-7a281bce7cb7 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:06.587912 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-fe4f4055-3869-402d-8ada-ff99b9101186 req-e056cd6e-5535-4efd-a442-7a281bce7cb7 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:06.606704 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-fe4f4055-3869-402d-8ada-ff99b9101186 req-e056cd6e-5535-4efd-a442-7a281bce7cb7 service nova] Creating event network-changed:1c51f956-0113-45f5-b6b4-fe6b787d4b5a for instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 on hv-cinder-85220 Sep 06 16:18:06.612104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-fe4f4055-3869-402d-8ada-ff99b9101186 req-e056cd6e-5535-4efd-a442-7a281bce7cb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040510 Sep 06 16:18:06.613232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 249/522] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:06.657311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:06.665901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-04a50643-50bc-4c01-ade2-50547ca3b775 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.185656 Sep 06 16:18:06.666601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 274/523] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:06 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:07.098180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:07.100112 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:07.113415 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.115159 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.115597 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.116399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.117031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.117450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.366561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:07.375861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-45a28e22-6368-423d-a12a-a4286681dbbf tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1508 microversion: 2.1 time: 0.286613 Sep 06 16:18:07.376435 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 250/524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:07 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:07.577511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:07.578683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:07.584616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.585124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.585557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.586245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.586719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.587147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.690253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:07.691245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:07.697685 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.698176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.698613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.699374 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:07.699824 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:07.700252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:07.728716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:07.736905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-94cc76d9-cc2d-4ece-876e-a5651ccc0058 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.163248 Sep 06 16:18:07.737628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 275/525] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:07 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:07.836582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:07.845284 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-af5aec6c-b979-428f-927a-fe533f803f1e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.159754 Sep 06 16:18:07.845863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 251/526] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:07 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:08.760608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:08.761342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:08.768503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.768997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.769453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.770159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.770741 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.771254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.868878 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:08.869754 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:08.879599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.880172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.880741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.881659 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:08.882197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:08.882870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:08.926398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:08.934748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-886dfddb-4935-4682-85e2-30f0bbb44d8d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.177830 Sep 06 16:18:08.935638 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 276/527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:08 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:09.053364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:09.063107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b0cb0910-b1c9-451f-9053-e9975072aec7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1359 microversion: 2.1 time: 0.198127 Sep 06 16:18:09.074762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 252/528] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:08 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:09.958754 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:09.959369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:09.961330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:09.966924 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:09.967446 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:09.967886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:09.969383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:09.969839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:09.970265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.104656 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:10.111256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:10.112287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:10.117780 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0d7f7fdc-da09-45bf-b2d9-15d5c83d51c2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.162480 Sep 06 16:18:10.118797 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 277/529] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:09 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:10.131357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.131795 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.132241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.132956 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.133415 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.133846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.278978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:10.287291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c30e6519-1fb6-4ffa-917a-6e324bf1b4f5 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1549 microversion: 2.1 time: 0.183950 Sep 06 16:18:10.287872 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 253/530] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:10 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:10.311001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:10.311718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:10.318451 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.318972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.319411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.320140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.320591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.321020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.344186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:10.491592 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:10.500560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-927833e8-4158-4ab2-863f-0e227bc80226 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1549 microversion: 2.1 time: 0.192700 Sep 06 16:18:10.500885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 278/531] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:10 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:10.523439 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:10.528422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:10.529187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Searching by: {'deleted': False, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc'} {{(pid=120738) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 16:18:10.536137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.536613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.537043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.537768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.538216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.538645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.634491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.multi_cell_list [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120738) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 16:18:10.735489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-079b1bf7-43c8-45e3-baf2-ff41f6ec0925 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215732 Sep 06 16:18:10.735996 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 254/532] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Sep 6 16:18:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:10.751666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:10.752395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:10.759004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.759485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.759920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.760618 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:10.761064 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:10.761486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:10.902645 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:10.912234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-70b4dd62-f1d7-4639-84ba-ab495e6875a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1549 microversion: 2.1 time: 0.167722 Sep 06 16:18:10.912825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 279/533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:10 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:11.145871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:11.149398 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:11.154727 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:11.155052 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:11.156394 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:11.157620 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:11.158287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:11.158789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:11.372931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:11.381189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6f6f490a-b3d1-4acc-9cbb-e4fb828ddbdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.240761 Sep 06 16:18:11.381768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 255/534] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:11 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:12.408845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:12.409816 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:12.415901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:12.416381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:12.416814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:12.417504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:12.417952 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:12.418370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:12.570055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:12.578815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-52d700e9-9463-423f-aece-e8125b4c77d4 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.175038 Sep 06 16:18:12.579413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 280/535] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:12 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:13.601297 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:13.601910 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:13.609189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:13.610350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:13.610829 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:13.611534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:13.611986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:13.612649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:13.753271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:13.760883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0536468e-3e46-467d-911e-fbf75fd6bdb2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.163410 Sep 06 16:18:13.761473 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 256/536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:13 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:14.784379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:14.784939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:14.787169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:14.792597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:14.793082 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:14.793514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:14.794215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:14.794688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:14.795109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:14.940560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:14.949356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ae7bcca3-2909-4bf5-a3b1-9ddcf64dad6f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.169001 Sep 06 16:18:14.949950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 281/537] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:14 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:15.980216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:15.980773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:15.988501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:15.988980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:15.989408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:15.990108 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:15.990554 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:15.991004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:16.362485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:16.370189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-81239684-9608-4b94-8e67-9811803508a5 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.393843 Sep 06 16:18:16.370733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 257/538] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:15 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:17.393746 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:17.394380 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:17.400305 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:17.400774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:17.401197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:17.401869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:17.402725 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:17.403144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:17.538317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:17.545903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7a27df44-e855-4131-81c8-d0bf59270db6 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.156461 Sep 06 16:18:17.546851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 282/539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:17 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:18.570135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:18.571841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:18.580018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:18.580222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:18.580659 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:18.581357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:18.581845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:18.582217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:18.722717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:18.731515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-76f056fc-9dad-409f-99de-594e1bd747a0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.165421 Sep 06 16:18:18.731987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 258/540] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:18 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:19.754545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:19.755181 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:19.761124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.761601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.762042 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.762779 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:19.763220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:19.763678 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:19.928350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:19.935977 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b312335c-9295-4056-a06c-9d67ae776928 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.185361 Sep 06 16:18:19.936537 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 283/541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:19 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:20.046078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b82129ae-c411-4526-ac7f-3c58f03b0c04"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:20.049091 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:20.056031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.056512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.056943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.057646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.058090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.058505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.356293 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e0a45f85-22de-4453-9788-fdc3b86e8e3d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314208 Sep 06 16:18:20.356933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 259/542] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:18:20 2022] POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:20.787166 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-aa884d82-d6b7-44fb-ade3-75b778b5f152 req-9a28d574-4d02-4e4d-be9e-06e4eb216d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabc80db-90dc-4ac2-85a4-d86a4e2506e3", "name": "network-vif-plugged", "status": "completed", "tag": "1c51f956-0113-45f5-b6b4-fe6b787d4b5a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:20.800489 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-aa884d82-d6b7-44fb-ade3-75b778b5f152 req-9a28d574-4d02-4e4d-be9e-06e4eb216d9d service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.801520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-aa884d82-d6b7-44fb-ade3-75b778b5f152 req-9a28d574-4d02-4e4d-be9e-06e4eb216d9d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.802150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-aa884d82-d6b7-44fb-ade3-75b778b5f152 req-9a28d574-4d02-4e4d-be9e-06e4eb216d9d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.816273 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-aa884d82-d6b7-44fb-ade3-75b778b5f152 req-9a28d574-4d02-4e4d-be9e-06e4eb216d9d service nova] Creating event network-vif-plugged:1c51f956-0113-45f5-b6b4-fe6b787d4b5a for instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 on hv-cinder-85220 Sep 06 16:18:20.821633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-aa884d82-d6b7-44fb-ade3-75b778b5f152 req-9a28d574-4d02-4e4d-be9e-06e4eb216d9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044515 Sep 06 16:18:20.822712 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 284/543] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:20.974013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:20.974801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:20.977301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:20.983497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.984863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.985313 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:20.986031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:20.986488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:20.986945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:21.220578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:21.231813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-df6290fc-6589-49df-ad0b-70587a06140a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.275750 Sep 06 16:18:21.232918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 260/544] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:20 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:22.260772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:22.261388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:22.268624 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.269141 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.269590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:22.270309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:22.270794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:22.271223 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:22.422049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:22.431353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0fedf6a8-d185-4b24-8ee4-c76cfbd2f346 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.175472 Sep 06 16:18:22.431944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 285/545] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:22 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:18:23.456524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:23.457341 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:23.464547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:23.465032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:23.465472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:23.466178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:23.466631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:23.467078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:23.617527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:23.626083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-18c9c685-0858-47ab-a3d4-7c7fc31ebfcf tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1369 microversion: 2.1 time: 0.174137 Sep 06 16:18:23.626805 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 261/546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:23 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:24.650076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:24.650719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:24.656606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.657092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.657527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.658267 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.659076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.659310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.804021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:24.809113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-add98e25-6ad6-4d2d-8799-8152c77a0167 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1562 microversion: 2.1 time: 0.162771 Sep 06 16:18:24.809708 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 286/547] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:24 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:24.833413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:24.834101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:24.841830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.842523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.843554 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.844584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:24.845444 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:24.846234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:24.963241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-88bb6f89-1a44-45f6-98c1-f090933f4465 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134254 Sep 06 16:18:24.963961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 262/548] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:18:24 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:25.907577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:25.911034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:25.921802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.922306 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.922774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:25.923521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:25.924094 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:25.924532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:26.075738 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:26.086100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bc8164ef-02c3-483d-b3c5-683ebe9b33ae tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1595 microversion: 2.1 time: 0.181702 Sep 06 16:18:26.086100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 287/549] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:25 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1595 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:18:26.262311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-b0afec5d-8602-4e4e-abc0-979c15ba3420 req-839260f4-bd60-4cdb-88d2-acf8f923d93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabc80db-90dc-4ac2-85a4-d86a4e2506e3", "tag": "1c51f956-0113-45f5-b6b4-fe6b787d4b5a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:26.270067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=58 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:26.283398 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b0afec5d-8602-4e4e-abc0-979c15ba3420 req-839260f4-bd60-4cdb-88d2-acf8f923d93e service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:26.285060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b0afec5d-8602-4e4e-abc0-979c15ba3420 req-839260f4-bd60-4cdb-88d2-acf8f923d93e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:26.285559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b0afec5d-8602-4e4e-abc0-979c15ba3420 req-839260f4-bd60-4cdb-88d2-acf8f923d93e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:26.301582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-b0afec5d-8602-4e4e-abc0-979c15ba3420 req-839260f4-bd60-4cdb-88d2-acf8f923d93e service nova] Creating event network-changed:1c51f956-0113-45f5-b6b4-fe6b787d4b5a for instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 on hv-cinder-85220 Sep 06 16:18:26.307501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-b0afec5d-8602-4e4e-abc0-979c15ba3420 req-839260f4-bd60-4cdb-88d2-acf8f923d93e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049233 Sep 06 16:18:26.308120 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 263/550] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:28.498111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-144c4a70-dae8-4714-ac56-c1e875c221eb req-0790f0b8-8414-44c6-b9e9-c0db308deef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c69f8-26fd-4b9a-900d-11a0dc0e22b8", "tag": "602703ac-73bc-4d76-8d30-7fc671f1225e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:28.511063 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-144c4a70-dae8-4714-ac56-c1e875c221eb req-0790f0b8-8414-44c6-b9e9-c0db308deef0 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:28.511536 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-144c4a70-dae8-4714-ac56-c1e875c221eb req-0790f0b8-8414-44c6-b9e9-c0db308deef0 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:28.512529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-144c4a70-dae8-4714-ac56-c1e875c221eb req-0790f0b8-8414-44c6-b9e9-c0db308deef0 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:28.531136 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-144c4a70-dae8-4714-ac56-c1e875c221eb req-0790f0b8-8414-44c6-b9e9-c0db308deef0 service nova] Creating event network-changed:602703ac-73bc-4d76-8d30-7fc671f1225e for instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 on hv-cinder-85220 Sep 06 16:18:28.542861 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-144c4a70-dae8-4714-ac56-c1e875c221eb req-0790f0b8-8414-44c6-b9e9-c0db308deef0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048521 Sep 06 16:18:28.544050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 288/551] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:29.974595 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1507742576"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:29.975307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:29.981612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.982099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.982540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.983277 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:29.983730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:29.984153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:29.986778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:18:30.112836 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.network.security_group_api [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Adding security group bd938232-ed0c-4ef8-a3c0-d73839a6ce27 to port 602703ac-73bc-4d76-8d30-7fc671f1225e Sep 06 16:18:30.444402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ba0b2401-4f6a-489c-a5f5-106e5dda12c4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/action" status: 202 len: 0 microversion: 2.1 time: 0.475020 Sep 06 16:18:30.453181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 264/552] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:18:29 2022] POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:18:30.455373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:18:30.456380 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:18:30.463289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:30.464058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:30.469447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-9ed99913-bd36-450f-9c4a-6a3309828a7c req-ee1ca746-44f2-451f-bb16-e7076bb6aeee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c69f8-26fd-4b9a-900d-11a0dc0e22b8", "tag": "602703ac-73bc-4d76-8d30-7fc671f1225e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:18:30.471742 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:30.473423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:30.474145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:30.474683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:30.482524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-9ed99913-bd36-450f-9c4a-6a3309828a7c req-ee1ca746-44f2-451f-bb16-e7076bb6aeee service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:18:30.483547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-9ed99913-bd36-450f-9c4a-6a3309828a7c req-ee1ca746-44f2-451f-bb16-e7076bb6aeee service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:18:30.484436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-9ed99913-bd36-450f-9c4a-6a3309828a7c req-ee1ca746-44f2-451f-bb16-e7076bb6aeee service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:18:30.500016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-9ed99913-bd36-450f-9c4a-6a3309828a7c req-ee1ca746-44f2-451f-bb16-e7076bb6aeee service nova] Creating event network-changed:602703ac-73bc-4d76-8d30-7fc671f1225e for instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 on hv-cinder-85220 Sep 06 16:18:30.506034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-9ed99913-bd36-450f-9c4a-6a3309828a7c req-ee1ca746-44f2-451f-bb16-e7076bb6aeee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040025 Sep 06 16:18:30.507405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 265/553] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:18:30.672343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:18:30.681897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6d3a1062-3741-4f9d-a8ba-e9734a8bc5fa tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1761 microversion: 2.1 time: 0.231662 Sep 06 16:18:30.682488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 289/554] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:18:30 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1761 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:06.342351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=5 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:06.343266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=5 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:06.347801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:06.348422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:06.356498 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:06.356995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:06.357435 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:06.358143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:06.358603 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:06.359059 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:06.385002 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a66ce94a-35c6-44cc-b65d-af67a06ab9e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/ips" status: 200 len: 149 microversion: 2.1 time: 0.043923 Sep 06 16:19:06.385596 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 266/555] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:19:06 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:09.923516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff6ab4c7-bf0a-4d10-a165-d4d17b267927"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:09.925834 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:09.928068 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=17 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:09.928715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=60 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:09.935660 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.936140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.936573 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:09.937266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:09.937723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:09.938147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:10.620379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ca4e9bb6-a299-45d7-8e07-8b4e5f104a6c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700579 Sep 06 16:19:10.624967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 290/556] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:19:09 2022] POST /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:21.213459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2128935078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-357680795", "security_groups": [{"name": "tempest-secgroup-smoke-1699639780"}], "networks": [{"uuid": "6b39e828-5cbd-4721-974e-fc783a0ff750"}], "block_device_mapping_v2": [{"uuid": "7d0a48a0-234e-4a66-807e-b356b52f5540", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:21.225984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:21.226633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=4 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:21.646981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] validate_networks() for [('6b39e828-5cbd-4721-974e-fc783a0ff750', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:19:21.663135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:21.664299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:21.670784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bce6d66-4e68-4c88-b157-af2991635a73", "device": "/dev/sdb"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:21.674793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:21.684666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.685395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.685903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:21.686710 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:21.687283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:21.687765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:22.145334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2d272c16-e3d5-4230-bb5e-4c817d08726f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "POST /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484649 Sep 06 16:19:22.145982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 291/557] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:19:21 2022] POST /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:19:22.405317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:19:22.406101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:19:22.406623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:19:22.407171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:19:22.408501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:19:22.418279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:22.419016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:22.419458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:22.420189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:22.420636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:22.421055 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:22.441496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Getting quotas for project abf281d8694e486da6d616fe43107474. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:19:22.446472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Getting quotas for user e0eaab966616458592a89cdef9cf63c3 and project abf281d8694e486da6d616fe43107474. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:19:22.506351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:19:22.508586 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d0a48a0-234e-4a66-807e-b356b52f5540',volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:19:22.658481 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f9eba05a-7556-4cf4-9825-6155024d3179 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.448704 Sep 06 16:19:22.659500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 267/558] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:19:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:19:22.672822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c5aea41c-e4f3-4c21-9287-b84052e55e10 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:22.674198 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c5aea41c-e4f3-4c21-9287-b84052e55e10 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:22.734952 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c5aea41c-e4f3-4c21-9287-b84052e55e10 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:22.742422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c5aea41c-e4f3-4c21-9287-b84052e55e10 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1088 microversion: 2.1 time: 0.075462 Sep 06 16:19:22.743833 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 292/559] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:22 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:23.779593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:23.780674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:23.786924 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:23.787411 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:23.787859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:23.788537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:23.788985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:23.789404 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:23.851712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:23.860311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9803bc4b-f5c3-4a13-be20-cb8edb6eb63c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1186 microversion: 2.1 time: 0.085230 Sep 06 16:19:23.860878 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 268/560] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:23 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:24.885778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:24.887768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:24.895869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.896336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.896772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:24.897466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:24.897976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:24.898700 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:25.045904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:25.054057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e6cd6da2-acda-4dc9-9dfd-e70695bfb72b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.173857 Sep 06 16:19:25.054645 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 293/561] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:24 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:25.598513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-f425d6fa-41c1-48a9-9201-6c852d20d943 req-eecefcb3-ce15-4903-bd3a-55f4d6766438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc7093e-ac27-4690-84d8-033d4912129e", "tag": "ef59344c-d6c6-4288-bbb7-4716d65ba16e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:25.609558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f425d6fa-41c1-48a9-9201-6c852d20d943 req-eecefcb3-ce15-4903-bd3a-55f4d6766438 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:25.610127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f425d6fa-41c1-48a9-9201-6c852d20d943 req-eecefcb3-ce15-4903-bd3a-55f4d6766438 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:25.610795 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f425d6fa-41c1-48a9-9201-6c852d20d943 req-eecefcb3-ce15-4903-bd3a-55f4d6766438 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:25.624258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-f425d6fa-41c1-48a9-9201-6c852d20d943 req-eecefcb3-ce15-4903-bd3a-55f4d6766438 service nova] Creating event network-changed:ef59344c-d6c6-4288-bbb7-4716d65ba16e for instance fdc7093e-ac27-4690-84d8-033d4912129e on hv-cinder-85220 Sep 06 16:19:25.629100 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-f425d6fa-41c1-48a9-9201-6c852d20d943 req-eecefcb3-ce15-4903-bd3a-55f4d6766438 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034320 Sep 06 16:19:25.629863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 269/562] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:26.078138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:26.078824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:26.085304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:26.085728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:26.086168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:26.086907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:26.087362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:26.087789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:26.229343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:26.238050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f87154ff-c57b-485c-b657-a5d564269ecc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.164214 Sep 06 16:19:26.238630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 294/563] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:26 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:27.264490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:27.265114 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:27.271711 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.272204 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.272640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:27.273349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:27.273805 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:27.274232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:27.409867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:27.417598 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-272103c2-4c34-49bf-8b5a-ef86e8792788 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.159857 Sep 06 16:19:27.418189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 270/564] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:27 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:28.441238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:28.442348 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:28.449629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:28.450225 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:28.450694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:28.451400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:28.451872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:28.452299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:28.585485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:28.593648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0aff82e4-db67-48ad-b7bd-2b9679048649 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.156866 Sep 06 16:19:28.594229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 295/565] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:28 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:29.617110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:29.617760 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:29.624488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:29.624973 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:29.625408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:29.626109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:29.626564 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:29.627021 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:29.766471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:29.774485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-481917be-df38-4186-ab41-402aeac308ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.161292 Sep 06 16:19:29.775083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 271/566] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:29 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:30.798077 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:30.798720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:30.801150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:19:30.801301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Tue Sep 6 16:19:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e (ip 10.222.0.26) !!! Sep 06 16:19:30.808774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:30.809441 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:30.809887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:30.810608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:30.811265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:30.811506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:30.959325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:30.968041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-12aeefb7-2185-4fe3-ad45-ae334ff24681 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.174453 Sep 06 16:19:30.968622 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 296/567] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:30 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:31.991788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:31.992455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:32.001544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.002441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.003271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.004238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:32.004701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:32.005133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:32.137531 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:32.145200 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-93cfd4b5-77f5-4e37-9eab-9474e7adf5cf tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.157760 Sep 06 16:19:32.145766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 272/568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:31 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:33.170102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:33.170753 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:33.174266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:33.182037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:33.182633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:33.183177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:33.184567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:33.185039 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:33.185470 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:33.344275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:33.352695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9f8ad23b-6013-40f3-ba5c-1df39cb41310 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.188021 Sep 06 16:19:33.353269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 297/569] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:33 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:34.377950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:34.378835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:34.380574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:34.381288 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:34.388920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:34.389406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:34.389840 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:34.390550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:34.391029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:34.391455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:34.547073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:34.554906 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5145a8a8-0bd2-485e-b79c-c3e274f62bf5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.181224 Sep 06 16:19:34.555527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 273/570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:34 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:34.602374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-98290c63-9b88-4898-8537-56258561efbe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: .version_select at 0x7f21b82cc0d0>, body: {"keypair": {"name": "tempest-keypair-1669618949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAMW4dORn0CH9Sk9MEirrkkB0PBMCgGDga5ww8HpAZADXm07zQVz6InR1cS2lkBNOhjKaUwEzh8fTRzQWNu9P3lFYy6DlkvCUc6d5nENkkryj9mxkghIMOTfhWfeuSz9g=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:34.618244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-98290c63-9b88-4898-8537-56258561efbe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:19:34.622628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-98290c63-9b88-4898-8537-56258561efbe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:19:34.645288 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-98290c63-9b88-4898-8537-56258561efbe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047378 Sep 06 16:19:34.645895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 298/571] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:19:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:19:35.581258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:35.582094 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:35.589401 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.589895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.590391 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:35.591220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:35.591682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:35.592109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:35.857299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:35.881348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-87a29643-dd81-4c7c-80ab-ac6334558438 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.302368 Sep 06 16:19:35.883123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 274/572] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:35 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:36.123458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1457584206", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5719a142-0389-455c-a92f-618471f11ba9"}], "security_groups": [{"name": "tempest-securitygroup--1435608221"}], "key_name": "tempest-keypair-1669618949", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:36.247013 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] validate_networks() for [('5719a142-0389-455c-a92f-618471f11ba9', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:19:36.808679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:19:36.809146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:19:36.809760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:19:36.810169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:19:36.810731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:19:36.820005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.820491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.820923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.821783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.822249 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.822828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.841222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:19:36.845767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:19:36.858511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:19:36.861298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:19:36.910057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:36.910633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:36.917344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.917700 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2047d051-ce39-4143-b526-4d7f41347654 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.799761 Sep 06 16:19:36.917874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.918292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.918548 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 299/573] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:19:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:19:36.919385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:36.919900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:36.920334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:36.938087 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e0c61b82-78c2-43bc-bd96-a7bbe1202ca6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:36.938981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e0c61b82-78c2-43bc-bd96-a7bbe1202ca6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:37.040456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e0c61b82-78c2-43bc-bd96-a7bbe1202ca6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:37.049333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e0c61b82-78c2-43bc-bd96-a7bbe1202ca6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1242 microversion: 2.1 time: 0.118331 Sep 06 16:19:37.050188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 300/574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:36 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:37.101402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:37.111137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9a79c79e-3bee-4c4c-8241-864e33c3f9bd tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.205008 Sep 06 16:19:37.111703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 275/575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:36 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:38.078401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:38.079046 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:38.085989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.086525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.088189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.089388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.089930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.091130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.134045 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:38.134917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:38.141727 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.142217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.142688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.143396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:38.143852 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:38.144279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:38.162120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:38.170838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ce78bba2-7473-4edf-a666-8f71fda2012c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1294 microversion: 2.1 time: 0.096993 Sep 06 16:19:38.171511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 301/576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:38 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:38.295253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:38.303135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3c672627-af91-4b6c-a5a1-a04408d810fb tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.173238 Sep 06 16:19:38.303712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 276/577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:38 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:39.196815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:39.201911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:39.217178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.217792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.218461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.220848 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.221922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.222792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.331845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:39.333025 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:39.346489 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:39.355308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a3f52b1b-0718-49b0-bd0e-ee3f7908db50 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1300 microversion: 2.1 time: 0.163399 Sep 06 16:19:39.355887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 302/578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:39 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1300 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:39.359186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.362183 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.363272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.364788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:39.368860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:39.370166 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:39.601688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:39.610213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1c73878f-e802-4aac-95b3-b6b626e931ac tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.286629 Sep 06 16:19:39.611078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 277/579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:39 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:40.380681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:40.381298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:40.390109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:40.390894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:40.391680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:40.392539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:40.393140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:40.393641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:40.570282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:40.585978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aa1aa090-7184-46b7-9730-a61a78699c5b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.209028 Sep 06 16:19:40.586781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 303/580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:40 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:40.637909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:40.639206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:40.650867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:40.652043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:40.652647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:40.653987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:40.654623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:40.656327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:40.894223 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:40.904122 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-da737769-f3fc-45d5-86fe-5a57f8d30ec3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.273933 Sep 06 16:19:40.904835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 278/581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:40 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:40.995692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-41565b96-9aee-4131-b50d-50149ab025f3 req-40b4cf52-3988-4cf6-8cdc-9c6228df7138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736a6120-d82c-47e3-9565-163cdcc46d08", "tag": "62a38ff3-423a-46e4-aa4f-e94b62b85f77"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:41.007814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-41565b96-9aee-4131-b50d-50149ab025f3 req-40b4cf52-3988-4cf6-8cdc-9c6228df7138 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.008392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-41565b96-9aee-4131-b50d-50149ab025f3 req-40b4cf52-3988-4cf6-8cdc-9c6228df7138 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.008925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-41565b96-9aee-4131-b50d-50149ab025f3 req-40b4cf52-3988-4cf6-8cdc-9c6228df7138 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.038920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-41565b96-9aee-4131-b50d-50149ab025f3 req-40b4cf52-3988-4cf6-8cdc-9c6228df7138 service nova] Creating event network-changed:62a38ff3-423a-46e4-aa4f-e94b62b85f77 for instance 736a6120-d82c-47e3-9565-163cdcc46d08 on hv-cinder-85220 Sep 06 16:19:41.049993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-41565b96-9aee-4131-b50d-50149ab025f3 req-40b4cf52-3988-4cf6-8cdc-9c6228df7138 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059226 Sep 06 16:19:41.052092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 304/582] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:19:41.616040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:41.617010 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:41.626780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.626780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.626780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.627608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.628073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.628498 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.866573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:41.884125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2f9ea32f-48a0-4831-9afc-dca9771a52bf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.272253 Sep 06 16:19:41.885255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 279/583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:41 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:41.936012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:41.938341 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:41.948482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.949095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.949631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:41.950742 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:41.951270 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:41.951697 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:42.104071 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:42.113886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-587218dc-7655-49d8-b780-c82c6447e9c1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.186939 Sep 06 16:19:42.114580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 305/584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:41 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:42.913259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:42.914431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:42.921814 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.922306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.922773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:42.923484 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:42.923943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:42.924376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:43.063334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:43.071355 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c5635a26-30da-4d37-b486-f43f3b3f3869 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.165422 Sep 06 16:19:43.071928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 280/585] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:42 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:43.138195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:43.138740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:43.145184 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:43.145654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:43.146080 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:43.146789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:43.147233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:43.147649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:43.284962 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1710465168", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:19:43.289196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:43.297789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-70415c14-3084-4031-9c4a-72da65f0feba tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.164355 Sep 06 16:19:43.298692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 306/586] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:43 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:43.340844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] validate_networks() for None {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:19:43.860826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:19:43.861236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:19:43.861701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:19:43.862126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:19:43.862558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:19:43.871465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:43.872511 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:43.872947 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:43.873658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:43.874106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:43.874528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:43.891578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Getting quotas for project 5873c8fe7f6346d3aaf9e4d8a0da4d4e. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:19:43.895656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Getting quotas for user b4b5e94108d14067a2f760c89964b4f4 and project 5873c8fe7f6346d3aaf9e4d8a0da4d4e. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:19:43.907655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:19:43.909952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:19:43.966018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f413eeb6-eeba-4309-a3b1-c4cb08131b88 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684621 Sep 06 16:19:43.967988 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 281/587] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 16:19:43.978268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c1af38ca-c5c9-41e1-a44a-a9a76d5b09d1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:43.979097 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c1af38ca-c5c9-41e1-a44a-a9a76d5b09d1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:44.039471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1af38ca-c5c9-41e1-a44a-a9a76d5b09d1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:44.047355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c1af38ca-c5c9-41e1-a44a-a9a76d5b09d1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1215 microversion: 2.1 time: 0.072895 Sep 06 16:19:44.048048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 307/588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:43 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:44.095536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:44.096156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:44.102283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:44.102803 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:44.103250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:44.104008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:44.104395 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:44.104822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:44.241416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:44.253332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8c8de7d9-e31d-44c2-8304-7ffbbe849d07 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.161714 Sep 06 16:19:44.254114 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 282/589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:44 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:44.323195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:44.323807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:44.331333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:44.331820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:44.332253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:44.332944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:44.333393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:44.333822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:44.472208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:44.479975 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-85b282e6-6e42-47cc-b858-ec9fe795be2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.160595 Sep 06 16:19:44.480549 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 308/590] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:44 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:45.071460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:45.072054 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:45.079369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.079852 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.080283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.081089 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.081536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.081963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.146142 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:45.154005 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b0912700-6e0d-40bb-a834-3157c8f825cc tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.086579 Sep 06 16:19:45.154581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 283/591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:45 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:45.276416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:45.276950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:45.283121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.283637 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.284077 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.284768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.285221 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.285648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.420953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:45.428716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9219a878-5a02-4b4b-96ff-11c7e11a23d4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.156274 Sep 06 16:19:45.429283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 309/592] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:45 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:45.503632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:45.504252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:45.510245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.510832 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.511273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.511973 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:45.513054 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:45.514151 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:45.654287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:45.662333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e911d7b8-e58d-443a-8444-3b3f697ebaca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.162731 Sep 06 16:19:45.662939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 284/593] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:45 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:46.177702 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:46.178228 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:46.185009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.185538 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.185977 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.186704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.187143 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.187566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.249634 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:46.257625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-54a6c833-47e0-4a6a-8b93-315eddb59878 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.083771 Sep 06 16:19:46.260793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 310/594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:46 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:46.452753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:46.453440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:46.461283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.461770 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.462320 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.462940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.463395 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.463823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.485294 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:46.598235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:46.607390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-66fd57b3-9c1e-4c15-bfc8-72061391207a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.157542 Sep 06 16:19:46.607989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 285/595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:46 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:46.686466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:46.687240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:46.693832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.694321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.694781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.695467 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:46.695906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:46.696320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:46.715253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:46.831222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:46.834733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:46.844082 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-25c19144-9e98-460e-b481-6ab227c0ed5c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.161445 Sep 06 16:19:46.844671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 311/596] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:46 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:47.282314 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:47.282898 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:47.291649 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.292181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.292629 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:47.293358 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.293845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.294462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:47.355960 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:47.363583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b5b63143-11ec-49e1-b1d2-1b4c7beff94e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.086561 Sep 06 16:19:47.364139 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 286/597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:47 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:47.630564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:47.631218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:47.637423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.637967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.638267 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:47.638986 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.639431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.639845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:47.773008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:47.781235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-415ada9b-8e27-4917-9d15-cd286f1f3e4a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.154664 Sep 06 16:19:47.781798 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 312/598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:47 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:47.866987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:47.867521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:47.874356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.874866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.875299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:47.875993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:47.876438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:47.876920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.017549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:48.028503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-99c13a84-746a-4169-8898-1703669c273e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.164849 Sep 06 16:19:48.029105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 287/599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:47 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:48.386631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:48.387806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:48.393982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:48.394455 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:48.394919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.395602 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:48.396041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:48.396456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.457993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:48.466932 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-44293147-662f-415b-baba-a02fc1a4798a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.084109 Sep 06 16:19:48.467504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 313/600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:48 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:48.804717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:48.805174 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:48.812712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:48.813211 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:48.813670 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.814365 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:48.814852 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:48.815269 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:48.950124 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:48.958197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-878abdf9-4e29-4044-b380-4505d3dcdcc2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.157996 Sep 06 16:19:48.958790 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 288/601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:48 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:49.052440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:49.053049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:49.060263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.060726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.061206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.061904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.062393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.063022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.208854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:49.217699 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d3d6d48-5b8b-4793-87b0-f9ff6ab888ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.169502 Sep 06 16:19:49.218291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 314/602] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:49 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:49.489730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:49.490349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:49.496392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.497273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.497737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.498443 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.498927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.499357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.563503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:49.571301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bcd7ddda-5789-497c-a8a0-d205aa2678b5 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.085462 Sep 06 16:19:49.571859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 289/603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:49 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:49.980930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:49.982125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:49.988526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.989011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.989452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:49.990146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:49.990602 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:49.991049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.124172 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:50.131795 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3ce28d50-dc71-4123-abca-e611a4b78eab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.154790 Sep 06 16:19:50.132361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 315/604] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:49 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:50.241464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:50.242078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:50.248914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.249400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.249841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.250544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.251041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.251468 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.388491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:50.396655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-184a6709-48cf-4d89-ae6f-ba8cd25d3d39 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.158935 Sep 06 16:19:50.397246 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 290/605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:50 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:50.594745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:50.595364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:50.601646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.602135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.602574 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.603687 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:50.603786 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:50.604161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:50.669432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:50.677570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d6eb77eb-d03f-42d4-bd2d-33dfdef92f3a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.087143 Sep 06 16:19:50.678155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 316/606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:50 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:51.154262 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:51.154892 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:51.160847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.161322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.161823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.162432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.163501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.163501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.292527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:51.300982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f99fecbe-7a4f-43bf-9fa6-358b6995d619 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.150818 Sep 06 16:19:51.301548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 291/607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:51 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:51.420537 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:51.421079 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:51.427739 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.428243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.428663 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.429385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.429842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.430265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.564434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:51.573292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6940209c-a998-4d6d-b075-c494b238e057 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.157074 Sep 06 16:19:51.573808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 317/608] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:51 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:51.701619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:51.702148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:51.704042 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:51.709669 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.710153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.710593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.711315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:51.711767 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:51.712190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:51.780028 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:51.788115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3c7e92f3-88dd-4e32-aa3e-56a4323b694d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.091003 Sep 06 16:19:51.788694 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 292/609] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:51 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:52.324675 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:52.326103 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:52.328004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:52.333792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.334308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.334864 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.335720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.336179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.336601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.473764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:52.482406 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-21ae97b5-62bd-491c-a871-b2f0b491b624 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.161548 Sep 06 16:19:52.483027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 318/610] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:52 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:52.596464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:52.597081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:52.603557 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.604040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.604473 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.605168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.605645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.606063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.738347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:52.746682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-46b8518a-cdcc-4b08-8262-70dfa282e5d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.154015 Sep 06 16:19:52.748109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 293/611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:52 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:52.809803 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:52.810490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:52.816620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.817097 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.817526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.818470 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:52.818940 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:52.819356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:52.900065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:52.908185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cb11c461-5109-405f-9b64-ba6dbe876211 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.102413 Sep 06 16:19:52.908745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 319/612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:52 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:53.506630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:53.507261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:53.514621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.515213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.515762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.516642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.517225 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.517752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.661723 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:53.670473 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f0dfb5cd-098c-4f5c-8909-f3135dbcb118 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.167645 Sep 06 16:19:53.671086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 294/613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:53 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:53.771854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:53.772411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:53.779477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.779962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.780393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.781086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.781529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.781945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.916005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:53.924310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0578ba32-0920-441e-b766-5eb0599cf506 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.156390 Sep 06 16:19:53.924886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 320/614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:53 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:53.931542 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:53.932243 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:53.937650 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:53.938312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:53.940151 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.940706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.941207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:53.941920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:53.942378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:53.943112 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:54.007909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:54.016147 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-659f11f9-c642-4dcc-9e50-84f28b8f010c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.088359 Sep 06 16:19:54.016723 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 295/615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:53 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:54.693615 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:54.694142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:54.696057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=14 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:54.701358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:54.701834 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:54.702268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:54.702982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:54.703436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:54.703858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:54.837797 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:54.846260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f36a73f4-80cc-4ab6-b617-e4f63c5ff448 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.156755 Sep 06 16:19:54.846902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 321/616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:54 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:54.947648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:54.948707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:54.955884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:54.956377 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:54.956810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:54.957527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:54.957978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:54.958406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:55.039715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:55.040520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:55.048706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:55.049286 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:55.049783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:55.050529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:55.051043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:55.051503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:55.117470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:55.118169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:55.126414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-997005bc-bb31-44c8-a815-5ed6dfb4eb1d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.090901 Sep 06 16:19:55.127240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 322/617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:55 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:55.133630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ceda79d0-f265-485c-b879-f99c33a80d0f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.189595 Sep 06 16:19:55.136666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 296/618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:54 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:55.869501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:55.870110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:55.878817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:55.879337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:55.879773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:55.880513 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:55.880964 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:55.881419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:56.029392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:56.038380 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2858b488-02c6-498c-9c19-22a297b0c931 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.172651 Sep 06 16:19:56.038994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 323/619] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:55 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:56.149753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:56.150310 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:56.157311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:56.157801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:56.158243 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:56.158991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:56.159453 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:56.159878 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:56.175518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:56.176115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:56.181913 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:56.182387 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:56.182861 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:56.183541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:56.183985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:56.184398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:56.225954 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:56.236071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-890c1d9d-f236-42af-b5a1-6b06b3090eda tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.090249 Sep 06 16:19:56.237001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 297/620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:56 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:56.321232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:56.329252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a00dc383-3897-453c-a0b6-812eee6ef5d1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.157515 Sep 06 16:19:56.329807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 324/621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:56 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:57.062608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:57.063220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:57.069778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.070261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.070729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.071426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.071884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.072310 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.206264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:57.214128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3b06c25d-b68c-4568-8261-c726755cd1a2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.155535 Sep 06 16:19:57.214730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 298/622] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:57 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:57.259490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:57.260312 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:57.267673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.268193 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.268628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.269339 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.269817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.270237 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.340910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:57.348896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e11290bc-5549-459f-969d-37afe44cb0a9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.093242 Sep 06 16:19:57.349489 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 325/623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:57 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:57.359773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:57.360385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:57.366340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.366872 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.367308 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.367997 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:57.368444 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:57.368867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:57.502599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:57.510189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-94f6b524-ea14-4d80-b6cf-e47f0d75078c tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.155270 Sep 06 16:19:57.510915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 299/624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:57 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:58.238031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:58.238550 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:58.244605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.245086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.245518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.246200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.246647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.248741 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.371367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:58.372201 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:58.378779 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.379778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.379778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.380387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.380842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.381262 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.381870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:58.390512 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2333a84c-e678-4d9b-90f5-a7c9346ac32d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.156320 Sep 06 16:19:58.391525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 326/625] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:58 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:58.444861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:58.458330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2dbbfd35-ccfd-497b-8702-9b1348f355ed tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.090679 Sep 06 16:19:58.458957 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 300/626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:58 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:58.534937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:58.535467 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:58.541623 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.542113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.542554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.543293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:58.543826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:58.544229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:58.677402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:58.685443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cdd0a63e-2286-4310-8984-a8c19c655a4a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.154619 Sep 06 16:19:58.686015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 327/627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:58 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:59.413939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:59.414551 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:59.421709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.422188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.422621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.423346 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.423796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.424222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.481813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:59.482444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:59.489478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.489972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.490411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.491170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.491624 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.492139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.496480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:19:59.556505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:59.561088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:59.565086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ca41d8b4-e3f6-4211-b2e7-bc8795b4f0ba tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.087555 Sep 06 16:19:59.565862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 328/628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:59 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:19:59.571689 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c174de2f-3ca7-458b-b355-e1c7598356ed tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.161579 Sep 06 16:19:59.572260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 301/629] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:59 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:19:59.708974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:19:59.709492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:19:59.715344 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.716382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.716813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.717490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:19:59.717938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:19:59.718467 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:19:59.855946 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:19:59.865241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-21c00320-4ba7-40b8-8150-23f231ed6fa1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.160107 Sep 06 16:19:59.865824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 329/630] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:19:59 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:00.587854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:00.588492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:00.594240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:00.594892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:00.595130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.595628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.596073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:00.596780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.597241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.597667 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:00.601444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.601883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:00.601990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.602363 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:00.603114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.603556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.603981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:00.661404 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:00.669862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9145ff52-bf36-44d7-8121-60f8f0918ca7 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1219 microversion: 2.1 time: 0.085136 Sep 06 16:20:00.670881 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 302/631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:00 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:00.736529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:00.744253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-10da6cc1-2018-498b-9214-0123f5292492 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.153769 Sep 06 16:20:00.744825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 330/632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:00 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:00.897121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:00.897763 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:00.904340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.904850 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.905293 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:00.906008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:00.906549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:00.907023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.045563 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:01.054028 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-63136bb6-f072-4488-9eee-0ad460555d04 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1272 microversion: 2.1 time: 0.161100 Sep 06 16:20:01.054603 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 303/633] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:00 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:01.694126 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:01.694795 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:01.702280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.702882 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.703327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.704037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.704490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.704922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.768312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:01.768943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:01.769482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:01.775676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.776168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.776610 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.777360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:01.777775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:01.777984 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ba726e17-3fb8-42e2-826a-8ec2d9b72b2a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1211 microversion: 2.1 time: 0.088443 Sep 06 16:20:01.779127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 331/634] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:01 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:01.779452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:01.928156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:01.936838 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-67762826-4c34-4699-b144-fe89b77ab9ea tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.173057 Sep 06 16:20:01.937590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 304/635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:01 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:02.078057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:02.078680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:02.084723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:02.085197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:02.085626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:02.086309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:02.086788 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:02.087212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:02.223446 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:02.231696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cc7f5ab1-80fc-4423-a2b5-5663d3e6d08a tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.157980 Sep 06 16:20:02.232289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 332/636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:02 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:02.801240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:02.801849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:02.808282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:02.808762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:02.809194 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:02.810821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:02.811291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:02.811716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:02.875083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:02.882623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-62b4151a-64c3-4c6e-be70-5a54d5f38fa1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1267 microversion: 2.1 time: 0.085215 Sep 06 16:20:02.883202 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 305/637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:02 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:02.963138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:02.963755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:02.971782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:02.972389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:02.973019 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:02.973766 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:02.974220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:02.974679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.109619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:03.117268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-23c12eea-6da9-4bef-8fd5-4f7942936bfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.157879 Sep 06 16:20:03.117837 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 333/638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:02 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:03.254247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:03.254946 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:03.260884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:03.261430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:03.261874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.262617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:03.263098 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:03.263631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.395947 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:03.404884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3f982b6c-f5b5-4b2d-bed4-e51239fad7fc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.154313 Sep 06 16:20:03.405492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 306/639] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:03 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:03.857635 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-20000b58-e46a-4ea2-a9b7-5ef47d5fb3ee req-a63c3c13-8f1a-4a1f-ba40-d19f70d024d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736a6120-d82c-47e3-9565-163cdcc46d08", "name": "network-vif-plugged", "status": "completed", "tag": "62a38ff3-423a-46e4-aa4f-e94b62b85f77"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:03.872422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-20000b58-e46a-4ea2-a9b7-5ef47d5fb3ee req-a63c3c13-8f1a-4a1f-ba40-d19f70d024d8 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:03.873308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-20000b58-e46a-4ea2-a9b7-5ef47d5fb3ee req-a63c3c13-8f1a-4a1f-ba40-d19f70d024d8 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:03.874070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-20000b58-e46a-4ea2-a9b7-5ef47d5fb3ee req-a63c3c13-8f1a-4a1f-ba40-d19f70d024d8 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.895357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-20000b58-e46a-4ea2-a9b7-5ef47d5fb3ee req-a63c3c13-8f1a-4a1f-ba40-d19f70d024d8 service nova] Creating event network-vif-plugged:62a38ff3-423a-46e4-aa4f-e94b62b85f77 for instance 736a6120-d82c-47e3-9565-163cdcc46d08 on hv-cinder-85220 Sep 06 16:20:03.903358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-20000b58-e46a-4ea2-a9b7-5ef47d5fb3ee req-a63c3c13-8f1a-4a1f-ba40-d19f70d024d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050037 Sep 06 16:20:03.904394 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 334/640] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:03.905515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:03.906161 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:03.921660 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:03.922152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:03.922637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.923399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:03.923884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:03.924315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:03.998544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:04.006376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f9ac0d89-acec-40ae-a523-a7fccb483499 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1267 microversion: 2.1 time: 0.104995 Sep 06 16:20:04.006980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 307/641] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:03 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:04.141294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:04.142001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:04.148893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:04.149246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:04.149714 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:04.150561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:04.151144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:04.151601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:04.305157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:04.313940 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b842acae-d76d-40df-a800-623e2fc0a8d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.177703 Sep 06 16:20:04.314529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 335/642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:04 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:04.427821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:04.432285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:04.439866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:04.440405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:04.440985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:04.441570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:04.442066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:04.442528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:04.626177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:04.633901 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a73545e5-9f9e-4929-a963-bd379237149f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.210150 Sep 06 16:20:04.634515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 308/643] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:04 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:05.029907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:05.030555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:05.036626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.037120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.037558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.038248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.038727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.039157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.101792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:05.110099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-057c694d-0d8c-4268-ad8c-beaafca4cfa0 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1267 microversion: 2.1 time: 0.084089 Sep 06 16:20:05.110724 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 336/644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:05 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:05.336890 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:05.337491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:05.344406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.344876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.345303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.345983 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.346428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.346886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.486576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:05.494230 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-859141a1-c17b-4a60-8e77-7b1d5454e5d8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.161219 Sep 06 16:20:05.494813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 309/645] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:05 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:05.656982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:05.657596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:05.664225 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.664718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.665149 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.666187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:05.666647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:05.667108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:05.804818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:05.813373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-79a9a44a-f14e-402a-b744-e29d09dec4bc tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.160803 Sep 06 16:20:05.814060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 337/646] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:05 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:06.133864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:06.134428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:06.140630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.141118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.141562 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.142264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.142753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.143180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.209533 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:06.217369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0049b2bb-17d5-4980-8ae5-7c6b0d0dde69 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1275 microversion: 2.1 time: 0.087702 Sep 06 16:20:06.217940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 310/647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:06 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:06.254570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:06.255106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:06.261027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.261507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.261939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.262627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.263121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.263532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.394428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lazy-loading 'services' on Instance uuid e3671dc8-5c23-42c5-94b6-572742974ed9 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:20:06.518058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:06.518640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8a6341fb-bf04-43a6-9010-224a6de9e33f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9/os-volume_attachments/3bce6d66-4e68-4c88-b157-af2991635a73" status: 202 len: 0 microversion: 2.1 time: 0.267434 Sep 06 16:20:06.519029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 338/648] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:20:06 2022] DELETE /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9/os-volume_attachments/3bce6d66-4e68-4c88-b157-af2991635a73 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:20:06.519128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:06.526179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.526771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.527203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.527897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.528342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.528760 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.739726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:06.747941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c15d30c1-47ad-4b90-9bbd-0aff23c99680 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1368 microversion: 2.1 time: 0.234693 Sep 06 16:20:06.748513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 311/649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:06 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:06.838556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:06.839278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:06.846036 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.846571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.847027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.847714 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:06.848161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:06.848579 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:06.983527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:06.991592 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-89d7dc99-d394-42f9-9b4e-2286543b2fc2 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.157690 Sep 06 16:20:06.992164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 339/650] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:06 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:07.241256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:07.241756 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:07.247981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.248462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.248891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:07.249591 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.250040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.250551 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:07.319544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:07.327456 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bedb3057-475b-4736-a9ac-90b1effe1a0d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1273 microversion: 2.1 time: 0.090173 Sep 06 16:20:07.328015 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 312/651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:07 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:07.771507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:07.772057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:07.777951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.778431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.778918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:07.779605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.780054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.780482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:07.925246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:07.933076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3107590a-7a33-4606-9838-98d6b4e28750 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1558 microversion: 2.1 time: 0.165566 Sep 06 16:20:07.933655 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 340/652] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:07 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:07.959371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:07.959922 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:07.967144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.967852 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.968283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:07.968980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:07.969660 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:07.970087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:08.014041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:08.014677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:08.020783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:08.021304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:08.021991 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:08.022642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:08.023255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:08.023634 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:08.073800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-34f0eabc-34f2-4f00-b673-ac781d658d8e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118311 Sep 06 16:20:08.074630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 313/653] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:20:07 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:08.174231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:08.182273 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-29e67fd6-0e8e-4f17-8abe-9c00d2e6e363 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.172737 Sep 06 16:20:08.182885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 341/654] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:08 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:08.351436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:08.352363 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:08.359102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:08.360601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:08.361253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:08.362205 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:08.362903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:08.363536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:08.703671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:08.712334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f5784d14-ddef-457a-8c17-8383c82e27cf tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.364810 Sep 06 16:20:08.713183 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 314/655] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:08 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:09.204906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:09.205514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:09.212199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.212662 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.213093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.213787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.214231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.214643 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.372058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:09.380551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eeb6e5ad-12f8-4486-a364-c342b472721d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.179959 Sep 06 16:20:09.381155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 342/656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:09 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:09.736547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:09.737278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:09.744821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.745446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.745987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.746823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.747379 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.747956 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.795124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:09.795705 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:09.802054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.802534 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.802994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.803748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.804125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.804544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.830479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:20:09.866354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:09.914382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fb413a0e-1f06-4a7f-b9cc-9213a14ac97c tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 204 len: 0 microversion: 2.1 time: 0.122732 Sep 06 16:20:09.916240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 343/657] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:20:09 2022] DELETE /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 16:20:09.925707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:09.925707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:09.931177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.931670 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.932156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:09.932860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:09.933317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:09.933738 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:10.077170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:10.089519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9e29a5cd-1d66-4948-ad7b-b0693aba5dd2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.357244 Sep 06 16:20:10.103970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 315/658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:09 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:10.136838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:10.146595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f5427a3a-222e-4629-a55e-d2690f5ad6c4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.226887 Sep 06 16:20:10.147580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 344/659] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:09 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:10.276396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-e3138aa0-7c25-44f5-b07b-cd9b333a4b6d req-fbed347c-d37e-409c-9209-416f08d1a5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736a6120-d82c-47e3-9565-163cdcc46d08", "tag": "62a38ff3-423a-46e4-aa4f-e94b62b85f77"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:10.287976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e3138aa0-7c25-44f5-b07b-cd9b333a4b6d req-fbed347c-d37e-409c-9209-416f08d1a5d2 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:10.288434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e3138aa0-7c25-44f5-b07b-cd9b333a4b6d req-fbed347c-d37e-409c-9209-416f08d1a5d2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:10.288863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e3138aa0-7c25-44f5-b07b-cd9b333a4b6d req-fbed347c-d37e-409c-9209-416f08d1a5d2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:10.307552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-e3138aa0-7c25-44f5-b07b-cd9b333a4b6d req-fbed347c-d37e-409c-9209-416f08d1a5d2 service nova] Creating event network-changed:62a38ff3-423a-46e4-aa4f-e94b62b85f77 for instance 736a6120-d82c-47e3-9565-163cdcc46d08 on hv-cinder-85220 Sep 06 16:20:10.312809 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-e3138aa0-7c25-44f5-b07b-cd9b333a4b6d req-fbed347c-d37e-409c-9209-416f08d1a5d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207439 Sep 06 16:20:10.314040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 316/660] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:10.404342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:10.405028 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:10.411819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:10.412343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:10.412829 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:10.413539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:10.414061 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:10.414487 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:10.573601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:10.581519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-786109d7-377d-4781-8427-61f96e5586ed tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.180976 Sep 06 16:20:10.582102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 345/661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:10 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:11.117044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:11.117748 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:11.123914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.124402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.124845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.126082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.126539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.126998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.171693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:11.172707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:11.179762 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.180253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.180694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.181431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.182086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.182899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.267338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:11.275080 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eb1996be-eb13-41cd-9479-0dd8cd967797 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.162742 Sep 06 16:20:11.275654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 317/662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:11 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:11.318312 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:11.325885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a2a95fb1-e4cb-42c6-bf6f-c296ff3cb4e7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.158627 Sep 06 16:20:11.326451 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 346/663] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:11 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:11.605603 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:11.606219 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:11.612638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.613130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.613567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.614275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:11.614765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:11.615193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:11.754575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:11.762209 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-379874d7-a701-483c-bdad-4f731883fa08 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.160508 Sep 06 16:20:11.762784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 318/664] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:11 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:12.298642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:12.299188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:12.305571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.306057 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.306487 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.307369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.307821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.308242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.327860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-29cc3457-6a59-4539-afdf-41a8687345f6 req-a1ce5179-42e4-4ef9-a2b9-9f9c75c3739e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7713cf-2b14-4f71-adff-a71f1db4d474", "tag": "6a935bcc-9263-481d-bf96-5e689043870f"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:12.338452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-29cc3457-6a59-4539-afdf-41a8687345f6 req-a1ce5179-42e4-4ef9-a2b9-9f9c75c3739e service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.338969 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-29cc3457-6a59-4539-afdf-41a8687345f6 req-a1ce5179-42e4-4ef9-a2b9-9f9c75c3739e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.339405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-29cc3457-6a59-4539-afdf-41a8687345f6 req-a1ce5179-42e4-4ef9-a2b9-9f9c75c3739e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.351415 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-29cc3457-6a59-4539-afdf-41a8687345f6 req-a1ce5179-42e4-4ef9-a2b9-9f9c75c3739e service nova] Creating event network-changed:6a935bcc-9263-481d-bf96-5e689043870f for instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 on hv-cinder-85220 Sep 06 16:20:12.356176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-29cc3457-6a59-4539-afdf-41a8687345f6 req-a1ce5179-42e4-4ef9-a2b9-9f9c75c3739e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031998 Sep 06 16:20:12.357001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 319/665] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:20:12.362867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:12.363575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:12.369830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.370318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.370785 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.371496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.371943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.372406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.391448 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:12.451949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:12.459654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cf18b1be-6e5c-4498-bb2f-863dedc58d6e tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.165257 Sep 06 16:20:12.460239 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 347/666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:12 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:12.518625 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:12.526630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7a172698-f7e0-4a08-966d-71f69342dcd6 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.168687 Sep 06 16:20:12.527233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 320/667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:12 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:12.784227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:12.784836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:12.791761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.792243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.792677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.793365 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:12.793813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:12.794234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:12.933206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:12.941045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6f00ef22-f37c-4622-b394-99e8c81c85d4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.160548 Sep 06 16:20:12.941611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 348/668] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:12 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:13.482942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:13.483510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:13.490122 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:13.490598 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:13.491062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:13.491754 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:13.492203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:13.492624 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:13.551724 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:13.552722 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:13.559862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:13.559862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:13.559862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:13.560567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:13.561050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:13.561494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:13.634388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:13.644833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c9588c21-4e48-4db0-9eb9-27f4c826bf15 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.165775 Sep 06 16:20:13.645820 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 321/669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:13 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:13.707721 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:13.715872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bb81590f-ac82-42ee-bdaa-3f45c9f878e2 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.168586 Sep 06 16:20:13.716667 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 349/670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:13 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:13.972067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:13.974529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:13.981848 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:13.982330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:13.982789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:13.983482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:13.983927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:13.984340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:14.120677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:14.128257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-52e5186f-b520-446a-80a0-26a886fcdd5f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.166713 Sep 06 16:20:14.128815 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 322/671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:13 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:14.668652 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:14.669286 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:14.675682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:14.676160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:14.676588 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:14.677773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:14.678227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:14.678654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:14.740417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:14.741134 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:14.747655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:14.748136 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:14.748567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:14.749266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:14.749714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:14.750135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:14.813663 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:14.822291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8f8e4ea8-c7f9-4695-a9c1-574828eecba8 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.157477 Sep 06 16:20:14.822896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 350/672] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:14 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:14.884160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:14.892068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eb898bd8-1881-4e4b-b47c-6965adc252be tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.156131 Sep 06 16:20:14.892647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 323/673] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:14 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:15.151197 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:15.151802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:15.157650 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.158113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.158546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.159249 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.159692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.160111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.300383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:15.309063 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-200f564d-8d56-408b-a905-08429b740b88 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.161612 Sep 06 16:20:15.309639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 351/674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:15 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:15.845298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:15.845942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:15.853402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.853861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.854341 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.855297 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.856013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.856450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.916801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:15.917412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:15.924156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.925437 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.925869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.926562 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:15.927078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:15.927542 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:15.999294 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:16.013031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a04978dc-5952-4c9e-b364-0468dddda6f1 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.171713 Sep 06 16:20:16.013717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 324/675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:15 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:16.077122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:16.085266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0f40c55a-fb2e-4a79-a63a-6c587520738a tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.172688 Sep 06 16:20:16.085825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 352/676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:15 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:16.332160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:16.332779 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:16.339182 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:16.339665 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:16.340101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:16.340801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:16.341260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:16.341716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:16.482401 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:16.490502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e5e2aebb-002d-46d8-bcaf-f0c659dcf3c4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.162197 Sep 06 16:20:16.491115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 325/677] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:16 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:17.036126 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:17.036863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:17.043243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.043720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.044145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.044829 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.045269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.045686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.168068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-5d1c6d8e-30f5-4e68-a50a-e4299377a7c1 req-1001983b-d22d-43af-98ea-a10dc8b25791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc7093e-ac27-4690-84d8-033d4912129e", "name": "network-vif-plugged", "status": "completed", "tag": "ef59344c-d6c6-4288-bbb7-4716d65ba16e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:17.178303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5d1c6d8e-30f5-4e68-a50a-e4299377a7c1 req-1001983b-d22d-43af-98ea-a10dc8b25791 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.179110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5d1c6d8e-30f5-4e68-a50a-e4299377a7c1 req-1001983b-d22d-43af-98ea-a10dc8b25791 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.179552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5d1c6d8e-30f5-4e68-a50a-e4299377a7c1 req-1001983b-d22d-43af-98ea-a10dc8b25791 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.189670 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:17.194563 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-5d1c6d8e-30f5-4e68-a50a-e4299377a7c1 req-1001983b-d22d-43af-98ea-a10dc8b25791 service nova] Creating event network-vif-plugged:ef59344c-d6c6-4288-bbb7-4716d65ba16e for instance fdc7093e-ac27-4690-84d8-033d4912129e on hv-cinder-85220 Sep 06 16:20:17.199899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a78f8827-0c72-4c1b-b3d5-49fd187ad8ca tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.167566 Sep 06 16:20:17.200615 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 353/678] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:17 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:17.201070 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-5d1c6d8e-30f5-4e68-a50a-e4299377a7c1 req-1001983b-d22d-43af-98ea-a10dc8b25791 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099501 Sep 06 16:20:17.201854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 326/679] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:17.206911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:17.207669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:17.214164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.214778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.215450 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.216368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.217181 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.217630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.363249 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:17.371396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eb07f5f7-c674-43d1-8178-eece5fb4d726 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.169087 Sep 06 16:20:17.371960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 354/680] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:17 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:17.513691 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:17.514419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:17.521458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.521939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.522374 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.523253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:17.523672 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:17.524099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:17.671433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:17.680086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1275d7b2-6ed6-4b5e-8921-046f5ca65951 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.170622 Sep 06 16:20:17.680665 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 327/681] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:17 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:18.223137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:18.223745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:18.230881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.231376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.231817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.232527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.232981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.233404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.367134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:18.383353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-95719b11-1431-46f2-a07b-266a9d3333de tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.164025 Sep 06 16:20:18.384040 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 355/682] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:18 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:18.393940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:18.394615 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:18.401765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.408163 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.408432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.409252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.414371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.414371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.547662 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:18.555570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e04e9431-40e2-4b0f-b056-a510921123ce tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1514 microversion: 2.1 time: 0.165450 Sep 06 16:20:18.556147 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 328/683] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:18 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:18.703399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:18.704033 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:18.710779 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.711252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.711681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.712360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:18.712806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:18.713227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:18.856343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:18.867008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3125440b-76f3-4907-9b02-f2aeac79eb2e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.167268 Sep 06 16:20:18.868359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 356/684] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:18 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:19.219539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-bada32de-9c1e-43d7-a0b5-88da74f33d91 req-b0c41260-48b9-4493-91a3-cd6e698c7ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3671dc8-5c23-42c5-94b6-572742974ed9", "name": "network-vif-unplugged", "status": "completed", "tag": "42495ad5-bd8b-4c9f-917a-9fda7028838e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:19.230288 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-bada32de-9c1e-43d7-a0b5-88da74f33d91 req-b0c41260-48b9-4493-91a3-cd6e698c7ce1 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.230810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-bada32de-9c1e-43d7-a0b5-88da74f33d91 req-b0c41260-48b9-4493-91a3-cd6e698c7ce1 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.231248 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-bada32de-9c1e-43d7-a0b5-88da74f33d91 req-b0c41260-48b9-4493-91a3-cd6e698c7ce1 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.243644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-bada32de-9c1e-43d7-a0b5-88da74f33d91 req-b0c41260-48b9-4493-91a3-cd6e698c7ce1 service nova] Creating event network-vif-unplugged:42495ad5-bd8b-4c9f-917a-9fda7028838e for instance e3671dc8-5c23-42c5-94b6-572742974ed9 on hv-cinder-85220 Sep 06 16:20:19.248646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-bada32de-9c1e-43d7-a0b5-88da74f33d91 req-b0c41260-48b9-4493-91a3-cd6e698c7ce1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032677 Sep 06 16:20:19.249234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 329/685] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:19.407143 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:19.408373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:19.415616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.416102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.416547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.417246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.417703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.418127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.555040 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:19.563490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d0200b53-92f7-4155-8dc3-bda30a080054 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.160527 Sep 06 16:20:19.564182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 357/686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:19 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:19.566173 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-c9d2f1d5-1b8c-4425-94f4-302ed2c1e199 req-b15bd4eb-9e33-4380-b931-115cc04cc19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3671dc8-5c23-42c5-94b6-572742974ed9", "name": "network-vif-deleted", "tag": "42495ad5-bd8b-4c9f-917a-9fda7028838e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:19.577773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-c9d2f1d5-1b8c-4425-94f4-302ed2c1e199 req-b15bd4eb-9e33-4380-b931-115cc04cc19e service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.578250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-c9d2f1d5-1b8c-4425-94f4-302ed2c1e199 req-b15bd4eb-9e33-4380-b931-115cc04cc19e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.578697 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-c9d2f1d5-1b8c-4425-94f4-302ed2c1e199 req-b15bd4eb-9e33-4380-b931-115cc04cc19e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.580077 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:19.580758 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:19.587773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.588283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.588745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.589642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.590086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.590511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.591280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-c9d2f1d5-1b8c-4425-94f4-302ed2c1e199 req-b15bd4eb-9e33-4380-b931-115cc04cc19e service nova] Creating event network-vif-deleted:42495ad5-bd8b-4c9f-917a-9fda7028838e for instance e3671dc8-5c23-42c5-94b6-572742974ed9 on hv-cinder-85220 Sep 06 16:20:19.596104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-c9d2f1d5-1b8c-4425-94f4-302ed2c1e199 req-b15bd4eb-9e33-4380-b931-115cc04cc19e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034584 Sep 06 16:20:19.596891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 330/687] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:20:19.656781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:19.665188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-40bc8e6d-6cd5-4aea-9308-0f241c7780e0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1472 microversion: 2.1 time: 0.089450 Sep 06 16:20:19.665750 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 358/688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:19 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:19.891986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:19.892905 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:19.900095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.900580 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.901014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:19.901704 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:19.902447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:19.902900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.064592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:20.073740 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-57295b5f-7074-481b-a49a-4729949c34b0 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.185835 Sep 06 16:20:20.074237 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 331/689] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:19 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:20.588900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:20.589749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:20.596573 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.597511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.598204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.600308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.600799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.601312 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.687713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:20.688327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:20.696222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.696715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.697179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.697896 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.698339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.698789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.737522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:20.738011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:20.738446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:20.738933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lazy-loading 'fault' on Instance uuid e3671dc8-5c23-42c5-94b6-572742974ed9 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:20:20.744891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:20.748567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:20.754257 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-368876b6-1cc1-4df2-93d8-253b430d54ad tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.169898 Sep 06 16:20:20.754879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 359/690] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:20 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:20.978868 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:20.986725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ca33e9a2-1261-4647-a4c7-2a615fb31e54 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1309 microversion: 2.1 time: 0.302973 Sep 06 16:20:20.987306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 332/691] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:20 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:21.096919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:21.097524 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:21.105481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.106022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.106399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.107158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.107597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.108015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.248099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:21.256884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1e6b628d-2061-4bd4-b489-96e82852bc00 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1260 microversion: 2.1 time: 0.163719 Sep 06 16:20:21.257499 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 360/692] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:21 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:21.665299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-e6b57502-1f87-47bf-828a-32e4e7799d0c req-74b02fc7-68b9-46fc-95b3-ef2d09c95159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7713cf-2b14-4f71-adff-a71f1db4d474", "name": "network-vif-plugged", "status": "completed", "tag": "6a935bcc-9263-481d-bf96-5e689043870f"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:21.675079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e6b57502-1f87-47bf-828a-32e4e7799d0c req-74b02fc7-68b9-46fc-95b3-ef2d09c95159 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.675612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e6b57502-1f87-47bf-828a-32e4e7799d0c req-74b02fc7-68b9-46fc-95b3-ef2d09c95159 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.676149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-e6b57502-1f87-47bf-828a-32e4e7799d0c req-74b02fc7-68b9-46fc-95b3-ef2d09c95159 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.688790 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-e6b57502-1f87-47bf-828a-32e4e7799d0c req-74b02fc7-68b9-46fc-95b3-ef2d09c95159 service nova] Creating event network-vif-plugged:6a935bcc-9263-481d-bf96-5e689043870f for instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 on hv-cinder-85220 Sep 06 16:20:21.694438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-e6b57502-1f87-47bf-828a-32e4e7799d0c req-74b02fc7-68b9-46fc-95b3-ef2d09c95159 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033409 Sep 06 16:20:21.695065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 333/693] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:21.777321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:21.777923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:21.784350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.784824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.785253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.785933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:21.786377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:21.787317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:21.921381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:21.929905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b9314b80-4346-4f23-86b7-1b9e29f43f9f tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.156357 Sep 06 16:20:21.930488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 361/694] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:21 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:22.011688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:22.012393 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:22.017647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=86 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:22.020482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.021374 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.022040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.024582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.025240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.025686 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.063058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.063550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.063983 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.064439 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lazy-loading 'fault' on Instance uuid e3671dc8-5c23-42c5-94b6-572742974ed9 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:20:22.110153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:22.119900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-828c29bf-fe4e-41d2-9bd8-765fbe922801 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1309 microversion: 2.1 time: 0.112213 Sep 06 16:20:22.120512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 334/695] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:22 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:22.281111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:22.281719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:22.289098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.289597 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.290025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.290971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.291426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.291851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.451567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:22.466458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f373a2a-5218-4a01-bf8a-647f0abffb9f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1443 microversion: 2.1 time: 0.189038 Sep 06 16:20:22.467522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 362/696] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:22 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1443 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:22.503607 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:22.504217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:22.510871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.511282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.511720 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.512408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.512859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.513284 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.644761 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:22.653285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a7ecd135-96e1-4b0e-a3b6-94acbdb7993d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1443 microversion: 2.1 time: 0.153533 Sep 06 16:20:22.653853 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 335/697] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:22 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:22.952667 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:22.953270 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:22.956069 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:22.963003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.963551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.963966 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:22.964789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:22.965436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:22.965867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:23.127843 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:23.137244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5706cc00-c3b2-401c-8bad-edd36df430b2 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.188243 Sep 06 16:20:23.138544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 363/698] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:22 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:23.145032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:23.147002 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:23.154132 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:23.154935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:23.155557 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:23.156438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:23.157051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:23.157644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:23.201798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:23.202601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:23.203066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:23.203523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lazy-loading 'fault' on Instance uuid e3671dc8-5c23-42c5-94b6-572742974ed9 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:20:23.300449 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:23.309311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d8f08c04-1714-489d-9af0-cb40a18734e5 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 200 len: 1309 microversion: 2.1 time: 0.168755 Sep 06 16:20:23.309926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 336/699] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:23 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:24.165198 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:24.165930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:24.173325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:24.173902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:24.174585 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.175336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:24.176023 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:24.176768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.331168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:24.334051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:24.335416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: e3671dc8-5c23-42c5-94b6-572742974ed9] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:24.343734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:24.344553 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:24.345321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.346385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:24.347027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:24.347677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.352898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-95bcdf0a-6671-4b89-8d4d-958205aaec13 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.192399 Sep 06 16:20:24.354455 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 364/700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:24 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:24.371484 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] HTTP exception thrown: Instance e3671dc8-5c23-42c5-94b6-572742974ed9 could not be found. Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Request method failure captured: Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 HTTP/1.1 Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3KCzVv5khc98jECUSjAyWSxQCJSfMQNDHQn3ldnWmKWqZRE28v6I9QUf1Go6EiBU5Ezt0to-t8sAodfyoxaoq_YTwkT_FPTnPXOqYFI_R45hs5IkffecqoMdz7Xo9jBEqrOLTNGl9n66d1QQus_h0zEQkI_edU8HJqMa2mwsn5XJLI Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 17e81ff9ac5c4468989eb31ba2130e0d Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesSnapshotTestJSON-829503941 Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:20:24.373361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesSnapshotTestJSON-829503941 Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 17e81ff9ac5c4468989eb31ba2130e0d Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-829503941 Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesSnapshotTestJSON-829503941-project Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: b266573c02ab476da327907dcfed5583 Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesSnapshotTestJSON-829503941-project Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance e3671dc8-5c23-42c5-94b6-572742974ed9 could not be found. Sep 06 16:20:24.374961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': 'e3671dc8-5c23-42c5-94b6-572742974ed9'} Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3671dc8-5c23-42c5-94b6-572742974ed9 could not be found. Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:20:24.375914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3671dc8-5c23-42c5-94b6-572742974ed9 could not be found. Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3671dc8-5c23-42c5-94b6-572742974ed9 could not be found. Sep 06 16:20:24.377671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:24.378982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Returning 404 to user: Instance e3671dc8-5c23-42c5-94b6-572742974ed9 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:20:24.378982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-23afebff-d0b2-4a0e-a3cf-b5ce77ba3c9e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9" status: 404 len: 111 microversion: 2.1 time: 0.045477 Sep 06 16:20:24.378982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 337/701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:24 2022] GET /compute/v2.1/servers/e3671dc8-5c23-42c5-94b6-572742974ed9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:20:24.763752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-9661017e-2a7c-40a3-a224-63ec347ea736 req-0d819a93-5b7d-4c21-9ecf-f49482af21c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc7093e-ac27-4690-84d8-033d4912129e", "tag": "ef59344c-d6c6-4288-bbb7-4716d65ba16e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:24.775205 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-9661017e-2a7c-40a3-a224-63ec347ea736 req-0d819a93-5b7d-4c21-9ecf-f49482af21c5 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:24.775571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-9661017e-2a7c-40a3-a224-63ec347ea736 req-0d819a93-5b7d-4c21-9ecf-f49482af21c5 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:24.776265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-9661017e-2a7c-40a3-a224-63ec347ea736 req-0d819a93-5b7d-4c21-9ecf-f49482af21c5 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:24.789418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-9661017e-2a7c-40a3-a224-63ec347ea736 req-0d819a93-5b7d-4c21-9ecf-f49482af21c5 service nova] Creating event network-changed:ef59344c-d6c6-4288-bbb7-4716d65ba16e for instance fdc7093e-ac27-4690-84d8-033d4912129e on hv-cinder-85220 Sep 06 16:20:24.794816 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-9661017e-2a7c-40a3-a224-63ec347ea736 req-0d819a93-5b7d-4c21-9ecf-f49482af21c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034824 Sep 06 16:20:24.796113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 365/702] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:25.377918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:25.378530 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:25.385826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:25.386301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:25.386966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:25.387851 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:25.388458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:25.389035 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:25.532698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:25.542039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0f7bc07b-744c-423b-98cc-523a3f3ee357 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.167911 Sep 06 16:20:25.543038 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 338/703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:25 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:26.575516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:26.576205 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:26.582231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:26.582738 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:26.583169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:26.584493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:26.584940 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:26.585359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:26.720410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:26.729164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ea80240c-82b4-4de4-a41c-f49a3d995a6a tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.158419 Sep 06 16:20:26.729753 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 366/704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:26 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:27.751538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:27.752162 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:27.759123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:27.759632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:27.760066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:27.760764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:27.761289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:27.761642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:27.780822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:27.897589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:27.905405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8dc502d4-777a-43a6-a4b1-c78c03a589d6 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.157641 Sep 06 16:20:27.905989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 339/705] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:27 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:28.928980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:28.929510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:28.936031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:28.936513 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:28.936945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:28.937668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:28.938117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:28.938537 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:29.072539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:29.080593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0557d141-8dfb-48a2-953d-5a85004ba531 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1315 microversion: 2.1 time: 0.155577 Sep 06 16:20:29.081177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 367/706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:28 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:30.104495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:30.105109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:30.111685 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.112110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.112548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.113240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.113698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.114129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.271274 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:30.280204 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6b7ce708-839d-4ba6-b120-bc957cc65013 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1465 microversion: 2.1 time: 0.179674 Sep 06 16:20:30.280779 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 340/707] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:30 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1465 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:30.329942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:30.330506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:30.337680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.338157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.338583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.339320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.339821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.340185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.366257 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:20:30.440299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-327c9099-81d5-4288-8add-0aaf43eac2fd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 204 len: 0 microversion: 2.1 time: 0.113899 Sep 06 16:20:30.440929 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 368/708] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:20:30 2022] DELETE /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:20:30.450404 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:30.451800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:30.459015 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.459788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.460224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.460919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:30.461364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:30.461778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:30.607965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:30.616164 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2a75421d-db74-4cde-a4e9-b14c4eeab208 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1471 microversion: 2.1 time: 0.170621 Sep 06 16:20:30.616813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 341/709] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:30 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:31.640254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:31.640957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:31.647860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:31.648348 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:31.648788 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:31.649493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:31.649966 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:31.650391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:31.808733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:31.816639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0ce96835-119d-4cbe-918f-906d6942e37c tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1471 microversion: 2.1 time: 0.180559 Sep 06 16:20:31.817218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 369/710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:31 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:32.841181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:32.841794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:32.848607 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:32.849167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:32.849572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:32.850285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:32.850774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:32.851205 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:32.992444 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:33.000404 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1a1c28a7-4e7a-4f53-a45e-876f8430f1ff tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1471 microversion: 2.1 time: 0.163357 Sep 06 16:20:33.001019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 342/711] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:32 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:34.028011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:34.028943 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:34.035586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:34.036072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:34.037264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:34.037789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:34.038249 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:34.038692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:34.179336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:34.190491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7ad2c2b2-74a9-4ebd-b0d0-9954f298adbd tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1471 microversion: 2.1 time: 0.166702 Sep 06 16:20:34.191605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 370/712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:34 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:35.215505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:35.216115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:35.222654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:35.223171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:35.223613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:35.224802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:35.225416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:35.225846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:35.642840 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:35.652050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-19a88d1f-1a75-4bc6-a45e-6ca4f6e80f23 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1471 microversion: 2.1 time: 0.440382 Sep 06 16:20:35.652645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 343/713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:35 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:36.675554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:36.676190 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:36.688642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:36.689148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:36.689771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:36.690533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:36.691024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:36.691454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:36.825119 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:36.832794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ddef0bc0-4e81-43b3-8907-3506f0c9f07d tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1471 microversion: 2.1 time: 0.161172 Sep 06 16:20:36.834460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 371/714] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:36 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:37.463574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-583695626", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "networks": [{"uuid": "8141e3b1-e4bc-40fd-93bc-983288e8c8d3"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:37.521600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] validate_networks() for [('8141e3b1-e4bc-40fd-93bc-983288e8c8d3', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:20:37.664877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-d042d0db-4eff-4ac2-8060-d60e8668e14d req-3c53fbff-cb6c-49bb-b4ac-99b5b794cdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7713cf-2b14-4f71-adff-a71f1db4d474", "name": "network-vif-deleted", "tag": "6a935bcc-9263-481d-bf96-5e689043870f"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:37.681364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d042d0db-4eff-4ac2-8060-d60e8668e14d req-3c53fbff-cb6c-49bb-b4ac-99b5b794cdd5 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.682924 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d042d0db-4eff-4ac2-8060-d60e8668e14d req-3c53fbff-cb6c-49bb-b4ac-99b5b794cdd5 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.683541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d042d0db-4eff-4ac2-8060-d60e8668e14d req-3c53fbff-cb6c-49bb-b4ac-99b5b794cdd5 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.704190 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-d042d0db-4eff-4ac2-8060-d60e8668e14d req-3c53fbff-cb6c-49bb-b4ac-99b5b794cdd5 service nova] Creating event network-vif-deleted:6a935bcc-9263-481d-bf96-5e689043870f for instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 on hv-cinder-85220 Sep 06 16:20:37.713478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-d042d0db-4eff-4ac2-8060-d60e8668e14d req-3c53fbff-cb6c-49bb-b4ac-99b5b794cdd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057819 Sep 06 16:20:37.714780 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 372/715] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:20:37.858416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:37.859184 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:37.867977 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.868767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.869207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.869914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.870365 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.870821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.907937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:37.908420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:37.908858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:37.909308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lazy-loading 'fault' on Instance uuid 8b7713cf-2b14-4f71-adff-a71f1db4d474 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:20:37.958005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4b5e94108d14067a2f760c89964b4f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5873c8fe7f6346d3aaf9e4d8a0da4d4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:37.972062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a62a6c53-c2c0-4486-8960-8cfc4a556cb9 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 200 len: 1305 microversion: 2.1 time: 0.117845 Sep 06 16:20:37.973892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 373/716] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:37 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:38.023506 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:20:38.023935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:20:38.024413 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:20:38.024821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:20:38.025264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:20:38.034233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:38.034743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:38.035182 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:38.035909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:38.037023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:38.037312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:38.055759 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Getting quotas for project 17e81ff9ac5c4468989eb31ba2130e0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:20:38.059952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Getting quotas for user b266573c02ab476da327907dcfed5583 and project 17e81ff9ac5c4468989eb31ba2130e0d. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:20:38.071635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:20:38.074102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:20:38.122322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3fd0b300-eecd-49e4-b511-b59ce4658c5f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662686 Sep 06 16:20:38.123580 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 344/717] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:20:38.135742 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-83a4d9b3-23fc-4fe2-a97a-7c407d67bed7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:38.136448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-83a4d9b3-23fc-4fe2-a97a-7c407d67bed7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:38.193296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-83a4d9b3-23fc-4fe2-a97a-7c407d67bed7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:38.202165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-83a4d9b3-23fc-4fe2-a97a-7c407d67bed7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1218 microversion: 2.1 time: 0.070757 Sep 06 16:20:38.212216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 374/718] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:38 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:38.996991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:38.997631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] [instance: 8b7713cf-2b14-4f71-adff-a71f1db4d474] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:39.004848 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.005381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.005810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.006511 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.006989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.007405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.022558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] HTTP exception thrown: Instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 could not be found. Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Request method failure captured: Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 HTTP/1.1 Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Mc23uTJWLvZegeY5AmDR602lyiKlJVhcutq5WPw4AUcxa8NFaMo7PjQSYlrmNKcy0bUWD4scEfQLWEKNTYzI9WpL6LXjHwwkKaLumu5jTwjxKTYwPMz6OBArON4jROhsqnj_CgFPVQx60GA1ZcJpYo7rpWiM-FDY6gi-4uYARf2sg Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 5873c8fe7f6346d3aaf9e4d8a0da4d4e Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-1623194996 Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:20:39.024152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5873c8fe7f6346d3aaf9e4d8a0da4d4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5873c8fe7f6346d3aaf9e4d8a0da4d4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5873c8fe7f6346d3aaf9e4d8a0da4d4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5873c8fe7f6346d3aaf9e4d8a0da4d4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-1623194996 Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 5873c8fe7f6346d3aaf9e4d8a0da4d4e Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-1623194996 Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-1623194996-project Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: b4b5e94108d14067a2f760c89964b4f4 Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-1623194996-project Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 could not be found. Sep 06 16:20:39.025684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '8b7713cf-2b14-4f71-adff-a71f1db4d474'} Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 could not be found. Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:20:39.026623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 could not be found. Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 could not be found. Sep 06 16:20:39.028177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:20:39.029512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] Returning 404 to user: Instance 8b7713cf-2b14-4f71-adff-a71f1db4d474 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:20:39.029512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-431ca95d-238c-4338-b17f-b461c5e93d49 tempest-VolumesNegativeTest-1623194996 tempest-VolumesNegativeTest-1623194996-project] 10.222.0.26 "GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474" status: 404 len: 111 microversion: 2.1 time: 0.032452 Sep 06 16:20:39.029512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 345/719] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:38 2022] GET /compute/v2.1/servers/8b7713cf-2b14-4f71-adff-a71f1db4d474 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:20:39.227403 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:39.228110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:39.234834 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.235323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.235773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.236469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:39.236917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:39.237339 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:39.301484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:39.309671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cc05a6bb-347e-4f8a-9842-72a5e4c2e259 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1270 microversion: 2.1 time: 0.086763 Sep 06 16:20:39.310702 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 375/720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:39 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:40.332871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:40.334231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:40.340903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:40.341464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:40.341922 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:40.342616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:40.343091 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:40.343508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:40.584931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:40.596130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-07fc6341-4748-4717-9769-810a5de6c0b0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.267034 Sep 06 16:20:40.599601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 346/721] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:40 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:41.188814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-86bf4edb-c2f0-4080-a443-99339c9a8d5b req-88ccb6c1-44f7-45fd-b7e0-9be2cf5f251c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9b58062-46ca-46d5-8e1f-300c2040ef48", "tag": "7596956a-9c98-447b-b8a9-ece42743995e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:41.208998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-86bf4edb-c2f0-4080-a443-99339c9a8d5b req-88ccb6c1-44f7-45fd-b7e0-9be2cf5f251c service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:41.210220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-86bf4edb-c2f0-4080-a443-99339c9a8d5b req-88ccb6c1-44f7-45fd-b7e0-9be2cf5f251c service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:41.211595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-86bf4edb-c2f0-4080-a443-99339c9a8d5b req-88ccb6c1-44f7-45fd-b7e0-9be2cf5f251c service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:41.237498 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-86bf4edb-c2f0-4080-a443-99339c9a8d5b req-88ccb6c1-44f7-45fd-b7e0-9be2cf5f251c service nova] Creating event network-changed:7596956a-9c98-447b-b8a9-ece42743995e for instance d9b58062-46ca-46d5-8e1f-300c2040ef48 on hv-cinder-85220 Sep 06 16:20:41.246629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-86bf4edb-c2f0-4080-a443-99339c9a8d5b req-88ccb6c1-44f7-45fd-b7e0-9be2cf5f251c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063696 Sep 06 16:20:41.247574 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 376/722] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:41.623484 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:41.624174 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:41.630986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:41.631483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:41.631919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:41.632620 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:41.633317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:41.633750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:41.775742 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:41.783984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1a2aefb5-e636-4bee-9b8b-c7fc6654030e tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.164443 Sep 06 16:20:41.784550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 347/723] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:41 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:42.809353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:42.810608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:42.816413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:42.816902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:42.817338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:42.818953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:42.819432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:42.819861 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:42.839554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:42.961651 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:42.969322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-790cbd48-0d6d-4920-8836-efdfb24005d4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.164943 Sep 06 16:20:42.969890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 377/724] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:42 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:43.993447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:43.994003 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:44.001254 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:44.001754 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:44.002186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:44.002936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:44.003391 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:44.003815 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:44.138599 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:44.140835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:44.147923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:44.148415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:44.148856 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:44.149567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:44.149703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:44.150024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:44.150453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:44.157816 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a13e1790-4bc7-48af-99c5-0ab2b9bd7315 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.168491 Sep 06 16:20:44.158399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 348/725] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:43 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:45.182281 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:45.183092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:45.189470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:45.189951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:45.190388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:45.191107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:45.191562 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:45.191995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:45.325526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:45.333347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b52da2cd-59e3-459a-8612-4086f6f31eb0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.155884 Sep 06 16:20:45.334014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 349/726] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:45 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:46.183088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d6287645-f447-4768-b8e5-b6e6845b1186 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action" status: 200 len: 31962 microversion: 2.1 time: 2.048200 Sep 06 16:20:46.183990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 378/727] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:20:44 2022] POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action => generated 31962 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:20:46.356213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:46.357791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:46.366863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:46.368156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:46.368734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:46.369713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:46.370560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:46.371066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:46.628336 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:46.637573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dfcefda6-5288-4be6-9c1a-b795e34fb744 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.285354 Sep 06 16:20:46.638144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 350/728] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:46 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:47.661437 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:47.662195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:47.669216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:47.669702 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:47.670167 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:47.670893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:47.671347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:47.671773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:47.808525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:47.817319 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-785ccb93-1a1b-442f-bb58-3570a73c5268 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.160030 Sep 06 16:20:47.817953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 379/729] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:47 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:48.841016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:48.841638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:48.844020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:48.844680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:48.851552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:48.852044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:48.852480 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:48.853183 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:48.853636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:48.854063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:48.987311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:48.995049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-706b61b5-d05e-46c0-be95-68b32d4f5f17 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.158038 Sep 06 16:20:48.995626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 351/730] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:48 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:49.289604 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:49.290186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:49.292545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:49.298043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:49.298528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:49.299013 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:49.299715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:49.300172 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:49.300599 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:49.326059 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e9512e97-e9e0-4c17-97f5-1f5324ed4a07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/ips" status: 200 len: 145 microversion: 2.1 time: 0.040491 Sep 06 16:20:49.326623 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 380/731] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:20:49 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:50.017490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:50.018130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:50.025086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:50.025574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:50.026013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:50.026729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:50.027186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:50.027614 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:50.166368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:50.174641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1980f756-e3ea-455d-80ab-8ff44703c811 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.160998 Sep 06 16:20:50.175238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 352/732] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:50 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:50.315520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e3d2c5d6-4932-4033-ae0a-9737cd7ba901 req-7c5593dd-3155-4fd2-8be7-91372f2c0e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b58062-46ca-46d5-8e1f-300c2040ef48", "name": "network-vif-plugged", "status": "completed", "tag": "7596956a-9c98-447b-b8a9-ece42743995e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:50.326015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e3d2c5d6-4932-4033-ae0a-9737cd7ba901 req-7c5593dd-3155-4fd2-8be7-91372f2c0e87 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:50.326496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e3d2c5d6-4932-4033-ae0a-9737cd7ba901 req-7c5593dd-3155-4fd2-8be7-91372f2c0e87 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:50.326952 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e3d2c5d6-4932-4033-ae0a-9737cd7ba901 req-7c5593dd-3155-4fd2-8be7-91372f2c0e87 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:50.337921 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-e3d2c5d6-4932-4033-ae0a-9737cd7ba901 req-7c5593dd-3155-4fd2-8be7-91372f2c0e87 service nova] Creating event network-vif-plugged:7596956a-9c98-447b-b8a9-ece42743995e for instance d9b58062-46ca-46d5-8e1f-300c2040ef48 on hv-cinder-85220 Sep 06 16:20:50.342790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e3d2c5d6-4932-4033-ae0a-9737cd7ba901 req-7c5593dd-3155-4fd2-8be7-91372f2c0e87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030993 Sep 06 16:20:50.343388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 381/733] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:51.199454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:51.200053 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:51.206828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:51.207315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:51.207753 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:51.208594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:51.209209 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:51.209641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:51.347217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:51.355865 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-47a5fd69-7e54-44d1-b18c-6cb4e18a86b4 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.160528 Sep 06 16:20:51.356444 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 353/734] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:51 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:52.382419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:52.383174 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:52.389888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:52.390379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:52.390865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:52.391591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:52.392048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:52.392480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:52.535226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:52.543782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4341b4e9-0541-49f6-aa74-74803082ea8f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1318 microversion: 2.1 time: 0.166902 Sep 06 16:20:52.544358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 382/735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:52 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:20:53.574332 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:20:53.575546 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:53.578604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:53.587666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:53.588250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:53.588747 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:53.589786 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:53.590268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:53.590706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:53.735972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:20:53.744748 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0ca208e7-d157-424c-855f-4f3e797cf387 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1508 microversion: 2.1 time: 0.181815 Sep 06 16:20:53.745325 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 354/736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:20:53 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:20:53.767606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "189ab550-f9b9-44cf-9061-7ef6c4c7d73b", "device": "/dev/sdb"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:53.769960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:53.772955 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:20:53.779524 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:53.780012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:53.780450 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:53.781156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:53.781608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:53.782038 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:54.057459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-25a2a6f9-f445-4a1d-926b-41a681dcd5b7 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "POST /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293154 Sep 06 16:20:54.058102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 383/737] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:20:53 2022] POST /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:20:55.606583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7481d48f-bfdb-4d91-8d82-3edcfec08894"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:20:55.609062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:20:55.616117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:55.616660 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:55.617148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:55.617923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:20:55.618415 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:20:55.618929 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:20:55.916790 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-aa7c9ea4-1de1-4362-bdc4-4d44c26ca46a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314030 Sep 06 16:20:55.917572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 355/738] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:20:55 2022] POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:11.039230 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:11.040002 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:11.044820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5d952857-b90c-48a6-983c-8e4dd073f69b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:11.052527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d952857-b90c-48a6-983c-8e4dd073f69b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.053013 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d952857-b90c-48a6-983c-8e4dd073f69b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.053442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d952857-b90c-48a6-983c-8e4dd073f69b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.116252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5d952857-b90c-48a6-983c-8e4dd073f69b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Going to try to stop instance {{(pid=120739) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 16:21:11.164628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5d952857-b90c-48a6-983c-8e4dd073f69b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action" status: 202 len: 0 microversion: 2.1 time: 0.127523 Sep 06 16:21:11.165188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 384/739] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:21:11 2022] POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:21:11.171381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:11.172668 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:11.177818 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:11.178532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:11.187251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.187743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.188183 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.188897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:11.189546 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:11.189979 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:11.348036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:11.357819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-51fe61b2-e230-434f-ad78-dfc66da4df68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.188036 Sep 06 16:21:11.358415 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 356/740] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:11 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:12.382803 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:12.383502 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:12.389883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:12.390372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:12.390980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:12.391683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:12.392129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:12.392547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:12.548580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:12.564755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ead44b5-396b-4f41-b324-1b94c0f081a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.186648 Sep 06 16:21:12.565456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 385/741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:12 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:13.595372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:13.596517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:13.610290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:13.610290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:13.610290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:13.610290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:13.612880 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:13.613338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:13.772408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:13.781537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d28e5ae9-f8ad-45d9-8047-b54e67cecc4f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.193090 Sep 06 16:21:13.782123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 357/742] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:13 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:14.806209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:14.806891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:14.814093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:14.814586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:14.815076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:14.815793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:14.816252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:14.816674 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:14.963971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:14.972950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bed578cd-cb3b-4b55-921f-02192f403063 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.170662 Sep 06 16:21:14.973554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 386/743] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:14 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:15.997588 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:15.998266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:16.005951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:16.006556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:16.007109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:16.007830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:16.008289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:16.008719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:16.173571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:16.183859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a6f5d036-6ec7-4a5a-bd0d-23ca8716b7ef tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.190223 Sep 06 16:21:16.184674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 358/744] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:15 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:17.209125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:17.210005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:17.216847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:17.217340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:17.217777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:17.218534 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:17.218980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:17.219407 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:17.378825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:17.388552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-88c62747-7c87-410c-8417-53c150a24179 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.184187 Sep 06 16:21:17.389145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 387/745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:17 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:18.413673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:18.414430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:18.421020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:18.421511 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:18.421978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:18.422714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:18.423171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:18.423599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:18.600811 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:18.609849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-969c26a9-47a6-4781-8254-3dfc9870ec67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.201112 Sep 06 16:21:18.610445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 359/746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:18 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:19.638354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:19.639417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:19.646819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:19.647320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:19.647761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:19.648469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:19.648921 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:19.649345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:19.809539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:19.826394 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0a9751a8-bb93-43d4-9048-9509f41dd560 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.192777 Sep 06 16:21:19.827397 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 388/747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:19 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:20.051664 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:20.053226 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:20.059791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:20.060255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:20.060684 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:20.061384 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:20.061828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:20.062248 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:20.235941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lazy-loading 'services' on Instance uuid d9b58062-46ca-46d5-8e1f-300c2040ef48 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:21:20.368501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-081a9f79-5afd-430d-8197-243eee367947 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48/os-volume_attachments/189ab550-f9b9-44cf-9061-7ef6c4c7d73b" status: 202 len: 0 microversion: 2.1 time: 0.320564 Sep 06 16:21:20.369126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 360/748] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:21:20 2022] DELETE /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48/os-volume_attachments/189ab550-f9b9-44cf-9061-7ef6c4c7d73b => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:21:20.857479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:20.858168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:20.865419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:20.865902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:20.866334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:20.867058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:20.867502 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:20.867917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:21.010646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:21.019255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3eb05d82-bb32-41d8-9b7b-7730048d2d68 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.165748 Sep 06 16:21:21.019857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 389/749] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:20 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:22.045320 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:22.046031 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:22.053176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.053673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.054116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.054881 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.055353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.055888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.204257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:22.213821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4b8ae2ad-ec28-4a4c-92ff-e704855b05f7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.173636 Sep 06 16:21:22.214412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 361/750] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:22 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:22.593404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:22.594084 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:22.601918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.602344 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.602817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.603542 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.603993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.604421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.634715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:21:22.729115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c69c4901-97ac-40de-b335-fe3b1a2d26bd tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 204 len: 0 microversion: 2.1 time: 0.138761 Sep 06 16:21:22.730390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 390/751] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:21:22 2022] DELETE /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 16:21:22.740113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:22.740736 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:22.747208 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.747693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.748132 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.748865 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:22.749303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:22.749725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:22.903536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:22.911908 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-149b7ebd-ec0e-482e-b7a2-67c6971f943d tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1514 microversion: 2.1 time: 0.176233 Sep 06 16:21:22.912720 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 362/752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:22 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:23.238054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:23.238794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:23.245598 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.246079 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.246507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:23.247229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.247675 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.248093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:23.398947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:23.407577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5bee7939-49b8-4b90-9388-d93d691530dc tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.173799 Sep 06 16:21:23.408161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 391/753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:23 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:23.937075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:23.937632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:23.944920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.945503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.945941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:23.946652 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:23.947129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:23.947549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:24.100099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:24.109582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-78a817c4-8972-4907-bb2f-eda80a5a13b1 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1514 microversion: 2.1 time: 0.176461 Sep 06 16:21:24.110165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 363/754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:23 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:24.432299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:24.432967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:24.439775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:24.440266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:24.440709 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:24.441421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:24.441877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:24.442305 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:24.596177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:24.610800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-622d1ed3-e66f-4b95-a0cf-cf4a4dee0b4d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.181870 Sep 06 16:21:24.611807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 392/755] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:24 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:25.141044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:25.142174 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:25.153789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.154397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.155194 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.156040 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.156564 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.156998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.320036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:25.329353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c233eadc-600e-4c26-b36b-791887d60cac tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1514 microversion: 2.1 time: 0.196198 Sep 06 16:21:25.330044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 364/756] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:25 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:25.649998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:25.650590 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:25.657800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.658389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.659021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.659965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:25.660523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:25.661062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:25.848091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:25.861626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-39d92536-c8fc-424f-bbf8-50eba34d5b6b tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.215837 Sep 06 16:21:25.862802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 393/757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:25 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:26.327532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-992e4559-6824-4989-9b55-93f537967b4d req-e4d9d91e-8059-4972-958d-e933e8e644c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9b58062-46ca-46d5-8e1f-300c2040ef48", "name": "network-vif-deleted", "tag": "7596956a-9c98-447b-b8a9-ece42743995e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:26.339199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-992e4559-6824-4989-9b55-93f537967b4d req-e4d9d91e-8059-4972-958d-e933e8e644c2 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.339706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-992e4559-6824-4989-9b55-93f537967b4d req-e4d9d91e-8059-4972-958d-e933e8e644c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.340112 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-992e4559-6824-4989-9b55-93f537967b4d req-e4d9d91e-8059-4972-958d-e933e8e644c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.354114 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-992e4559-6824-4989-9b55-93f537967b4d req-e4d9d91e-8059-4972-958d-e933e8e644c2 service nova] Creating event network-vif-deleted:7596956a-9c98-447b-b8a9-ece42743995e for instance d9b58062-46ca-46d5-8e1f-300c2040ef48 on hv-cinder-85220 Sep 06 16:21:26.360315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-992e4559-6824-4989-9b55-93f537967b4d req-e4d9d91e-8059-4972-958d-e933e8e644c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036681 Sep 06 16:21:26.360700 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:26.361380 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 365/758] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:21:26.362387 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:26.375185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.376179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.377037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.378715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.379570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.380840 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.469293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b266573c02ab476da327907dcfed5583', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e81ff9ac5c4468989eb31ba2130e0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:26.479428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2d8df87d-ccd9-47fc-a484-5b52e4d92de0 tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 200 len: 1303 microversion: 2.1 time: 0.126328 Sep 06 16:21:26.480246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 394/759] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:26 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:26.900644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:26.901358 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:26.907855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.908341 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.908776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:26.909476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:26.909922 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:26.910367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.055667 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:27.065513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c5a50c03-00b2-4628-80f7-107b4165a652 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.169117 Sep 06 16:21:27.066264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 366/760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:26 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:27.504389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:27.505680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] [instance: d9b58062-46ca-46d5-8e1f-300c2040ef48] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:27.512657 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.513137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.513570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.514269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:27.514757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:27.515170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:27.530458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] HTTP exception thrown: Instance d9b58062-46ca-46d5-8e1f-300c2040ef48 could not be found. Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Request method failure captured: Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 HTTP/1.1 Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3KCzVv5khc98jECUSjAyWSxQCJSfMQNDHQn3ldnWmKWqZRE28v6I9QUf1Go6EiBU5Ezt0to-t8sAodfyoxaoq_YTwkT_FPTnPXOqYFI_R45hs5IkffecqoMdz7Xo9jBEqrOLTNGl9n66d1QQus_h0zEQkI_edU8HJqMa2mwsn5XJLI Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 17e81ff9ac5c4468989eb31ba2130e0d Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotTestJSON-829503941 Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:21:27.532195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/17e81ff9ac5c4468989eb31ba2130e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotTestJSON-829503941 Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 17e81ff9ac5c4468989eb31ba2130e0d Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-829503941 Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotTestJSON-829503941-project Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: b266573c02ab476da327907dcfed5583 Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotTestJSON-829503941-project Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance d9b58062-46ca-46d5-8e1f-300c2040ef48 could not be found. Sep 06 16:21:27.534619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'd9b58062-46ca-46d5-8e1f-300c2040ef48'} Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9b58062-46ca-46d5-8e1f-300c2040ef48 could not be found. Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:21:27.536751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9b58062-46ca-46d5-8e1f-300c2040ef48 could not be found. Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9b58062-46ca-46d5-8e1f-300c2040ef48 could not be found. Sep 06 16:21:27.539609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:21:27.542282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] Returning 404 to user: Instance d9b58062-46ca-46d5-8e1f-300c2040ef48 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:21:27.542282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d89e0293-e2c2-4fdd-8d35-64e2203c092f tempest-VolumesSnapshotTestJSON-829503941 tempest-VolumesSnapshotTestJSON-829503941-project] 10.222.0.26 "GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48" status: 404 len: 111 microversion: 2.1 time: 0.033245 Sep 06 16:21:27.542282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 395/761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:27 2022] GET /compute/v2.1/servers/d9b58062-46ca-46d5-8e1f-300c2040ef48 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:21:28.089799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:28.090460 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:28.097284 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.097784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.098221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.098989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:28.099542 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:28.099972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:28.270023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:28.285793 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-530b9a7e-e629-4c2c-8985-783d773b0180 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.199804 Sep 06 16:21:28.287021 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 367/762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:28 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:29.311811 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:29.312336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:29.319881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.320375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.320821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:29.321529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:29.321982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:29.322410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:29.705394 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:29.714070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3e427740-a36c-48d1-981e-4a12dd8d798e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.406228 Sep 06 16:21:29.714653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 396/763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:29 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:30.993961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:30.994568 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:31.000640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:31.001121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:31.001555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:31.002253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:31.002724 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:31.003149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:31.150563 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:31.159714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-55a6d878-dbd5-44f1-aebd-7103886d6925 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.424202 Sep 06 16:21:31.160233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 368/764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:30 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:32.184617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:32.185238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:32.192421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:32.192913 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:32.193357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:32.194890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:32.195560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:32.196000 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:32.338625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:32.347066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f92ee4d9-02d8-48c6-95da-1d79ffe68ce1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.166282 Sep 06 16:21:32.347648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 397/765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:32 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:33.371653 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:33.372279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:33.378928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:33.379410 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:33.379842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:33.380537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:33.381622 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:33.382059 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:33.515446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:33.523567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ecd2750a-37db-4192-b4c4-611d9fc641f6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.155786 Sep 06 16:21:33.524127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 369/766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:33 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:34.547330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:34.547936 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:34.554515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:34.555062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:34.555504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:34.556196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:34.556662 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:34.557073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:34.579746 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:34.713601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:34.722156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ce62659e-2c83-4db2-abaa-0128843b5a7a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1721 microversion: 2.1 time: 0.178830 Sep 06 16:21:34.722744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 398/767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:34 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:35.745987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:35.746593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:35.752807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:35.753297 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:35.753876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:35.754604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:35.755106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:35.755503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:35.888272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:35.896345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-410c5fea-ac8d-47c9-aab3-f134954d6cee tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1698 microversion: 2.1 time: 0.154911 Sep 06 16:21:35.896903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 370/768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:35 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:35.919088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d696e115-f178-4dd6-9d4e-7ab6081dbf67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:35.925619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d696e115-f178-4dd6-9d4e-7ab6081dbf67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:35.926083 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d696e115-f178-4dd6-9d4e-7ab6081dbf67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:35.926510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d696e115-f178-4dd6-9d4e-7ab6081dbf67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:35.949170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d696e115-f178-4dd6-9d4e-7ab6081dbf67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Going to try to start instance {{(pid=120739) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 16:21:35.991883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d696e115-f178-4dd6-9d4e-7ab6081dbf67 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action" status: 202 len: 0 microversion: 2.1 time: 0.075757 Sep 06 16:21:35.992496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 399/769] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:21:35 2022] POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:21:36.000528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:36.001130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:36.008539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:36.009080 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:36.009775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:36.010774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:36.011455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:36.012253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:36.152802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:36.162757 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bba3e014-ecd7-4775-b123-811a47e15054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1707 microversion: 2.1 time: 0.165905 Sep 06 16:21:36.164417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 371/770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:35 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:37.188102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:37.188810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:37.198869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:37.199696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:37.200510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:37.201444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:37.202035 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:37.202474 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:37.344916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:37.353810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a959534c-6be6-405d-851c-12cd0c555386 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1707 microversion: 2.1 time: 0.170457 Sep 06 16:21:37.354551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 400/771] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:37 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1707 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:38.377577 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:38.378305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:38.385508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.386083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.386527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.387259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.387716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.388140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.410639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:38.540220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:38.548348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-390af7ce-e20b-4544-b62a-0f388a0348a6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1707 microversion: 2.1 time: 0.174690 Sep 06 16:21:38.548904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 372/772] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:38 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1707 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:38.720792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:38.723717 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:38.731343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.731819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.732251 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.732951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.733434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.733847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.815244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a8e99439-b14c-4b3d-a694-0b0795789b66 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/action" status: 202 len: 0 microversion: 2.1 time: 0.098331 Sep 06 16:21:38.815802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 401/773] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:21:38 2022] POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:21:38.829380 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:38.830012 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:38.836786 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.837271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.837710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:38.838420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:38.838917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:38.839347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.051927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:39.061429 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-76c73130-4dea-44eb-958f-93b79e242e78 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1753 microversion: 2.1 time: 0.241094 Sep 06 16:21:39.062035 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 373/774] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:38 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1753 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:39.575533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:39.576240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:39.586521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.587370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.587892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.588844 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:39.589621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:39.590304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:39.756845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:39.767044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c21bcbeb-997e-4281-a710-8129f825c6b2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1711 microversion: 2.1 time: 0.195743 Sep 06 16:21:39.767632 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 402/775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:39 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1711 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:40.089341 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:40.089955 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:40.096594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:40.097091 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:40.097568 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:40.098263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:40.098771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:40.099196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:40.265377 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:40.274066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f325fbda-e8bd-4ba2-b627-f7faa97bf6b3 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.188534 Sep 06 16:21:40.274640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 374/776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:40 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:41.299178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:41.299755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:41.301615 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:41.307053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:41.307532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:41.307960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:41.308639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:41.309081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:41.309494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:41.462260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:41.470592 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-372e2213-75b7-47d3-8a82-5b02bf8f4f5e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.175493 Sep 06 16:21:41.471199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 403/777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:41 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:42.493950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:42.494563 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:42.496887 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=39 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:42.502419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:42.502934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:42.503374 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:42.504073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:42.504527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:42.504954 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:42.657214 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:42.666329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-98c5378e-8fe7-487b-98fb-1ae7b2ba454c tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.176394 Sep 06 16:21:42.666955 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 375/778] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:42 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:43.691211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:43.691930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:43.699768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:43.700252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:43.700684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:43.701383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:43.701825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:43.702245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:43.871013 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:43.885671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f3dac40-f60a-43d6-aa0c-8ddbcd9c201d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.198519 Sep 06 16:21:43.886440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 404/779] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:43 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:44.910562 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:44.911143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:44.918509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.919027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.919472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:44.920185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:44.920635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:44.921081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:45.078155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:45.087805 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-01cbc36e-4180-47d3-8483-871a92a7f3ea tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.181121 Sep 06 16:21:45.088397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 376/780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:44 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:46.111285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:46.111921 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:46.119402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:46.120056 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:46.120661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:46.121680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:46.122310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:46.122898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:46.279651 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:46.288897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-02704a9f-bea3-4fe4-9747-b1a853d63e97 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.180867 Sep 06 16:21:46.289768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 405/781] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:46 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:47.313388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:47.314015 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:47.322272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:47.322797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:47.323235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:47.323935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:47.324391 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:47.324826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:47.470221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:47.478675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-66a603d3-7e6d-4fa3-ab86-0b861ad11082 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.169119 Sep 06 16:21:47.479273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 377/782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:47 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:48.503357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:48.503917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:48.510885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:48.511370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:48.511799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:48.512486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:48.512958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:48.513377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:48.671134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:48.680791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e6cc2849-384f-4742-a647-a5ed9d9009a2 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.181220 Sep 06 16:21:48.681434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 406/783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:48 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:49.706681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:49.707420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:49.713762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:49.714390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:49.714892 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:49.715724 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:49.716233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:49.716725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:49.872473 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:49.881310 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3ad31733-5ecf-47a0-9b06-9becb98ac081 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.178774 Sep 06 16:21:49.881891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 378/784] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:49 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:51.037420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:51.038383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:51.045768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:51.046265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:51.046758 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:51.047473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:51.047927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:51.048353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:51.208552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:51.217925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3acb91fc-a870-48d1-a8e5-8386fea2dcad tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.315646 Sep 06 16:21:51.218505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 407/785] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:50 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:52.243883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:52.244819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:52.251902 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:52.252392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:52.252835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:52.253549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:52.254006 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:52.254445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:52.413725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:52.422250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-414d6427-e926-4da1-bfea-48d1ce3d9d7d tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.183545 Sep 06 16:21:52.422887 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 379/786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:52 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:21:53.447414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:53.448023 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:53.455204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:53.455727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:53.456214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:53.457159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:53.457624 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:53.458051 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:53.606764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:53.615434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-707cfddd-d854-4e82-a9fe-d70c65265527 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.172812 Sep 06 16:21:53.616012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 408/787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:53 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:54.640232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:54.640868 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:54.647533 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:54.648019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:54.648456 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:54.649169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:54.649619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:54.650047 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:54.801855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:54.811022 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dafee570-efb8-4c1b-aac2-252415745665 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.176120 Sep 06 16:21:54.811600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 380/788] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:54 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:55.834565 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:55.835223 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:55.842222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:55.842740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:55.843188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:55.843905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:55.844359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:55.844782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:56.002431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:56.011605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-77ab6e26-b12c-4b20-8ee0-f1ebadbda6df tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.180825 Sep 06 16:21:56.012224 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 409/789] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:55 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:57.035874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:57.036775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:57.043792 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:57.044285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:57.044712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:57.045722 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:57.046177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:57.046635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:57.248068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:57.257918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-27d284e4-886e-4126-8eb9-281cc022e6f4 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.225853 Sep 06 16:21:57.268273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 381/790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:57 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:57.401997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a376f376-f758-431f-9589-155f5a050712"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:21:57.404929 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:57.411386 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:57.412682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:57.413579 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:57.414994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:57.416161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:57.416161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:57.827010 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-90c435c5-d346-4023-b28a-5310b4af50aa tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649277 Sep 06 16:21:57.828094 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 410/791] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:21:57 2022] POST /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:21:58.282532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:58.283196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:58.291447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:58.292008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:58.292536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:58.293300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:58.293804 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:58.294266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:58.492955 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:58.502450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-11182485-8401-4fa1-b884-ce0370340935 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.224019 Sep 06 16:21:58.503082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 382/792] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:58 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:21:59.529129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:21:59.529839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:21:59.536263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:59.536749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:59.537190 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:59.537897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:21:59.538354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:21:59.538819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:21:59.704766 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:21:59.708514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:21:59.715307 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-92e5b97d-8f74-4c00-b1af-5c854cae21db tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.191553 Sep 06 16:21:59.715903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 411/793] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:21:59 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:00.744281 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:00.744898 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:00.751289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:00.751776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:00.752212 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:00.752921 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:00.753372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:00.753798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:00.905246 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:00.913476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2990a094-7cc3-4cb5-a0b0-abbe5e8e2a75 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1758 microversion: 2.1 time: 0.173821 Sep 06 16:22:00.914087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 383/794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:00 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:01.937566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:01.938107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:01.947066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:01.947548 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:01.947976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:01.948700 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:01.949140 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:01.949557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:02.105374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:02.113867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d89afb1-2dad-41aa-abfe-8bc37e3fea4e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1761 microversion: 2.1 time: 0.180509 Sep 06 16:22:02.114853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 412/795] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:01 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1761 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:05.425019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:05.427343 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:05.434458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:05.434978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:05.435418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:05.436118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:05.436577 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:05.437005 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:05.461805 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lazy-loading 'flavor' on Instance uuid dabc80db-90dc-4ac2-85a4-d86a4e2506e3 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:05.592781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-deb27096-46f1-4536-b480-396a4472b71e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/action" status: 200 len: 32 microversion: 2.1 time: 0.171888 Sep 06 16:22:05.593381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 384/796] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:22:05 2022] POST /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:22:05.603073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:05.603684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:05.610285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:05.610797 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:05.611295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:05.611926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:05.612369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:05.612790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:05.753861 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:05.762933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-708daf84-2093-4fd6-9435-ec0d7526d830 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.163732 Sep 06 16:22:05.763526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 413/797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:05 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:06.789120 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:06.789946 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:06.796705 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:06.797198 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:06.797641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:06.798347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:06.798843 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:06.799280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:06.935617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:06.943769 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d7a784f3-6bce-4f25-abad-1ee9584a66ea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.159425 Sep 06 16:22:06.944340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 385/798] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:06 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:07.968349 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:07.969106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:07.975758 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:07.976241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:07.976822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:07.977525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:07.977976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:07.978401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:08.109146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:08.117317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-28c8a074-0754-49dc-a16e-91cbe7cbbab3 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.152831 Sep 06 16:22:08.117887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 414/799] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:07 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:09.141275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:09.141889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:09.149174 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:09.149683 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:09.150129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:09.150849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:09.151303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:09.151729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:09.155778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:09.282651 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:09.291698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-79be6684-9988-46cd-8013-a56fd014dad9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.154257 Sep 06 16:22:09.292286 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 386/800] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:09 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:10.315368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:10.315910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:10.322619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:10.323125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:10.323552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:10.324234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:10.324680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:10.325094 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:10.462216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:10.470720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-10da03c3-703a-4d5e-9afa-64a0d72a550d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.159260 Sep 06 16:22:10.471350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 415/801] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:10 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:11.494931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:11.495652 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:11.502057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.502540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.503015 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:11.503710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:11.504161 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:11.504586 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:11.644589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:11.653285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3f3d02aa-6425-4411-8f52-20514ce4d74f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.162756 Sep 06 16:22:11.653883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 387/802] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:11 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:12.677263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:12.677870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:12.680358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=26 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:12.685690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:12.686175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:12.686617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:12.687332 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:12.687784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:12.688216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:12.819726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:12.828899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bb286727-6b26-43a5-af6d-a245e3256065 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.155433 Sep 06 16:22:12.829472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 416/803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:12 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:13.852594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:13.853144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:13.855388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=26 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:13.860820 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:13.861307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:13.861743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:13.862436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:13.862921 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:13.863349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:13.996566 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:14.004759 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f28f0637-6b45-40c9-b8aa-5c0c358baf78 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.156276 Sep 06 16:22:14.005613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 388/804] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:13 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:15.028983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:15.029529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:15.035944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.036433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.036871 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:15.037558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:15.038008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:15.038434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:15.168853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:15.177015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bb385420-1315-4af6-82d9-369c091357bc tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.151962 Sep 06 16:22:15.177594 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 417/805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:15 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:16.201309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:16.201915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:16.208360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:16.208849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:16.209311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:16.210018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:16.210536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:16.211096 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:16.347604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:16.356249 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a5c4e02d-238f-415c-b9a7-1a7d4070e20a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.158907 Sep 06 16:22:16.357018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 389/806] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:16 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:17.380548 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:17.381219 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:17.388475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:17.388956 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:17.389393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:17.390090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:17.390538 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:17.390990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:17.529337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:17.537551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cff804cb-c60d-4473-bc3c-eff7b360afee tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.160830 Sep 06 16:22:17.538133 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 418/807] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:17 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:18.561029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:18.561714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:18.568788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:18.569263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:18.569704 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:18.571949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:18.571949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:18.572427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:18.709904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:18.719327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b9ef0166-96d0-4663-8948-2c28a0c164f8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.162207 Sep 06 16:22:18.720291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 390/808] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:18 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:19.744562 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:19.745166 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:19.751726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:19.752201 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:19.752633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:19.753322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:19.753772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:19.754191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:19.883376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:19.891646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6ab83836-ac71-48e4-8b2a-4d13d8d4b37f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.151359 Sep 06 16:22:19.892225 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 419/809] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:19 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:20.916627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:20.917169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:20.923719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:20.924205 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:20.926116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:20.926862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:20.927664 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:20.927894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:21.072805 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:21.081383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bbaa9626-ed8c-4e3f-9db2-8108e2efc17c tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1733 microversion: 2.1 time: 0.169736 Sep 06 16:22:21.081950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 391/810] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:20 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:22.107853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:22.108452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:22.115135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.115578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.116024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.116727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.117681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.118153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.257287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:22.265554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e12a6f10-9993-4382-b469-c28c9a9e71df tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1713 microversion: 2.1 time: 0.161600 Sep 06 16:22:22.266113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 420/811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:22 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:22.407592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:22.408117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:22.414967 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.415454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.415892 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.416584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.417060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.417512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.498368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] HTTP exception thrown: Cannot 'detach_volume' instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 while it is in vm_state rescued Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Request method failure captured: Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments/a376f376-f758-431f-9589-155f5a050712 HTTP/1.1 Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Hdgju97tQEPcRdHdLythvqGQSY2DsXgDVo-YwRbq86iiMwtEfs6p6WVIpgQQ8HXRst0XJLhtYylMq_O5tsHQdLVoaQvn0nvFuENdKxQ84q_KS_BHm6PtliV88UEis-RxvqrCTOwCt9tSKsl1IrIL-zmidECL4F0XaB00VFksv30dQ Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:22:22.500011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: eda6839efaab4317a0eda1f47f1656a2 Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:22:22.501726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Cannot 'detach_volume' instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 while it is in vm_state rescued Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'server_id': 'dabc80db-90dc-4ac2-85a4-d86a4e2506e3', 'id': 'a376f376-f758-431f-9589-155f5a050712'} Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:22:22.503459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 while it is in vm_state rescued Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 while it is in vm_state rescued Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:22.504972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Returning 409 to user: Cannot 'detach_volume' instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 while it is in vm_state rescued {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:22:22.506118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8ee78851-0598-440c-b129-6e3ec6c2b0c1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments/a376f376-f758-431f-9589-155f5a050712" status: 409 len: 152 microversion: 2.1 time: 0.097872 Sep 06 16:22:22.506118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 392/812] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:22:22 2022] DELETE /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments/a376f376-f758-431f-9589-155f5a050712 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 16:22:22.510643 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:22.511219 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:22.517152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.517662 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.518099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.518825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.519279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.519705 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.588447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-24aeb209-4b54-4b8f-8ed4-2eaed7cf1a34 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "POST /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/action" status: 202 len: 0 microversion: 2.1 time: 0.081738 Sep 06 16:22:22.592114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 421/813] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:22:22 2022] POST /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:22:22.597175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:22.597788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:22.605239 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.605718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.606153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.606885 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:22.607345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:22.607758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:22.823899 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:22.832026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6d28aec9-f430-42f9-add6-f31cc6fd5f0d tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1721 microversion: 2.1 time: 0.238656 Sep 06 16:22:22.832583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 393/814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:22 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:23.859026 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:23.859699 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:23.866194 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:23.866716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:23.867806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:23.868637 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:23.869094 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:23.869528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:24.001172 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:24.009444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e03d469f-4910-4974-b640-c188ff2b39d7 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1721 microversion: 2.1 time: 0.155198 Sep 06 16:22:24.010005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 422/815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:23 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:25.032138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:25.032707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:25.040013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:25.040602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:25.041141 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:25.041953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:25.042494 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:25.043033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:25.187053 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:25.197703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b2b4b81b-fdf0-431a-97d2-5f2e43d001ad tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1721 microversion: 2.1 time: 0.169380 Sep 06 16:22:25.198296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 394/816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:25 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:26.221733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:26.222372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:26.229439 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:26.229923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:26.230364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:26.231088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:26.231535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:26.231957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:26.365232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:26.374385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d63535ce-59a6-439e-8adb-3c65a10f1c63 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1721 microversion: 2.1 time: 0.157029 Sep 06 16:22:26.375055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 423/817] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:26 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:27.398120 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:27.398863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:27.405323 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:27.405810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:27.406250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:27.406978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:27.407544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:27.407953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:27.642166 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:27.650935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1f45d472-b20b-4ce8-b517-4a02af6e9a98 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1727 microversion: 2.1 time: 0.256661 Sep 06 16:22:27.651515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 395/818] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:27 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1727 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:27.674187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:27.674846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:27.681924 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:27.682413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:27.682894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:27.683609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:27.684071 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:27.684501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:27.767270 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8965e45e-1c96-485d-ac7c-54d36eff09f0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096870 Sep 06 16:22:27.767909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 424/819] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:22:27 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:29.002925 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-0aefef4a-6c49-46cb-97ad-dff2a1eb0be7 req-902bb8e6-c8f8-48f2-8c8b-d9d80e459b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabc80db-90dc-4ac2-85a4-d86a4e2506e3", "tag": "1c51f956-0113-45f5-b6b4-fe6b787d4b5a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:29.013610 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-0aefef4a-6c49-46cb-97ad-dff2a1eb0be7 req-902bb8e6-c8f8-48f2-8c8b-d9d80e459b44 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:29.014088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-0aefef4a-6c49-46cb-97ad-dff2a1eb0be7 req-902bb8e6-c8f8-48f2-8c8b-d9d80e459b44 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:29.014515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-0aefef4a-6c49-46cb-97ad-dff2a1eb0be7 req-902bb8e6-c8f8-48f2-8c8b-d9d80e459b44 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:29.026487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-0aefef4a-6c49-46cb-97ad-dff2a1eb0be7 req-902bb8e6-c8f8-48f2-8c8b-d9d80e459b44 service nova] Creating event network-changed:1c51f956-0113-45f5-b6b4-fe6b787d4b5a for instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 on hv-cinder-85220 Sep 06 16:22:29.031786 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-0aefef4a-6c49-46cb-97ad-dff2a1eb0be7 req-902bb8e6-c8f8-48f2-8c8b-d9d80e459b44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317912 Sep 06 16:22:29.032385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 396/820] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:31.047757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-2106b6a1-ce59-44e7-93f4-8cc7d14e1da7 req-b30c9916-18df-401a-95db-3d1a66ebce4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabc80db-90dc-4ac2-85a4-d86a4e2506e3", "tag": "1c51f956-0113-45f5-b6b4-fe6b787d4b5a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:31.058533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2106b6a1-ce59-44e7-93f4-8cc7d14e1da7 req-b30c9916-18df-401a-95db-3d1a66ebce4d service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:31.059120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2106b6a1-ce59-44e7-93f4-8cc7d14e1da7 req-b30c9916-18df-401a-95db-3d1a66ebce4d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:31.059601 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2106b6a1-ce59-44e7-93f4-8cc7d14e1da7 req-b30c9916-18df-401a-95db-3d1a66ebce4d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:31.072254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-2106b6a1-ce59-44e7-93f4-8cc7d14e1da7 req-b30c9916-18df-401a-95db-3d1a66ebce4d service nova] Creating event network-changed:1c51f956-0113-45f5-b6b4-fe6b787d4b5a for instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 on hv-cinder-85220 Sep 06 16:22:31.077544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-2106b6a1-ce59-44e7-93f4-8cc7d14e1da7 req-b30c9916-18df-401a-95db-3d1a66ebce4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Sep 06 16:22:31.078177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 425/821] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:44.910044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=17 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:44.910722 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=61 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:44.915628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:44.916243 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:44.923500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:44.923989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:44.924432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:44.925128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:44.925582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:44.926008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:44.949908 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-68fbf3d6-9824-4585-b1ce-6b46365455de tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08/ips" status: 200 len: 150 microversion: 2.1 time: 0.041528 Sep 06 16:22:44.950483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 397/822] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:22:44 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:44.959723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=19 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:44.960466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:22:44.965285 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff6ab4c7-bf0a-4d10-a165-d4d17b267927"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:44.967761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:44.975546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:44.976031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:44.977138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:44.977831 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:44.978287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:44.978750 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.060812 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Invalid volume: volume ff6ab4c7-bf0a-4d10-a165-d4d17b267927 is already attached to instances: 75eba83a-9a4e-46fb-854b-17e2f53a0444 Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08/os-volume_attachments HTTP/1.1 Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 74 Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:22:45.062870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {"volumeAttachment": {"volumeId": "ff6ab4c7-bf0a-4d10-a165-d4d17b267927"}} Sep 06 16:22:45.064723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Invalid volume: volume ff6ab4c7-bf0a-4d10-a165-d4d17b267927 is already attached to instances: 75eba83a-9a4e-46fb-854b-17e2f53a0444 Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'server_id': '736a6120-d82c-47e3-9565-163cdcc46d08', 'body': {'volumeAttachment': {'volumeId': 'ff6ab4c7-bf0a-4d10-a165-d4d17b267927'}}} Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ff6ab4c7-bf0a-4d10-a165-d4d17b267927 is already attached to instances: 75eba83a-9a4e-46fb-854b-17e2f53a0444 Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:45.065690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ff6ab4c7-bf0a-4d10-a165-d4d17b267927 is already attached to instances: 75eba83a-9a4e-46fb-854b-17e2f53a0444 Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:45.067161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ff6ab4c7-bf0a-4d10-a165-d4d17b267927 is already attached to instances: 75eba83a-9a4e-46fb-854b-17e2f53a0444 Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 400 to user: Invalid volume: volume ff6ab4c7-bf0a-4d10-a165-d4d17b267927 is already attached to instances: 75eba83a-9a4e-46fb-854b-17e2f53a0444 {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-81981493-12a6-4bb2-8652-7fcdeebc8c89 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106156 Sep 06 16:22:45.068626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 426/823] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:22:44 2022] POST /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:22:45.073740 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:45.074233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:45.080223 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.080699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.081127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.081802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.082280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.082715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.107727 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:22:45.181656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b729de74-09f7-404f-a31c-c0f606908ea9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 204 len: 0 microversion: 2.1 time: 0.111471 Sep 06 16:22:45.182400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 398/824] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:22:45 2022] DELETE /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:22:45.190231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:45.190872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:45.200268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.200754 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.201192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.201883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:45.202333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:45.202787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:45.333904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:45.342266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-111ad6b7-8b27-4033-bfb9-4e80e8b069b7 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1683 microversion: 2.1 time: 0.155828 Sep 06 16:22:45.342857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 427/825] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:45 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:46.365914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:46.366592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:46.373018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:46.373502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:46.373937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:46.374642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:46.375121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:46.375550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:46.507349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:46.515522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-86f51278-eedc-4509-8dae-495ccdbec132 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1683 microversion: 2.1 time: 0.153821 Sep 06 16:22:46.516086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 399/826] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:46 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:47.539960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:47.540495 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:47.547256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:47.547768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:47.548205 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:47.548898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:47.549345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:47.549767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:47.693820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:47.702496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e4f2b5d1-b3d1-4dcf-a44f-63c5ad0b4532 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1683 microversion: 2.1 time: 0.167184 Sep 06 16:22:47.703115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 428/827] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:47 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:48.545780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-dfd348fd-18a8-47d0-9040-b4e3e34512cd req-182af714-3ca4-4095-aa99-0419124b40f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736a6120-d82c-47e3-9565-163cdcc46d08", "name": "network-vif-deleted", "tag": "62a38ff3-423a-46e4-aa4f-e94b62b85f77"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:48.557741 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-dfd348fd-18a8-47d0-9040-b4e3e34512cd req-182af714-3ca4-4095-aa99-0419124b40f0 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:48.558416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-dfd348fd-18a8-47d0-9040-b4e3e34512cd req-182af714-3ca4-4095-aa99-0419124b40f0 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:48.558888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-dfd348fd-18a8-47d0-9040-b4e3e34512cd req-182af714-3ca4-4095-aa99-0419124b40f0 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:48.571948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-dfd348fd-18a8-47d0-9040-b4e3e34512cd req-182af714-3ca4-4095-aa99-0419124b40f0 service nova] Creating event network-vif-deleted:62a38ff3-423a-46e4-aa4f-e94b62b85f77 for instance 736a6120-d82c-47e3-9565-163cdcc46d08 on hv-cinder-85220 Sep 06 16:22:48.577560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-dfd348fd-18a8-47d0-9040-b4e3e34512cd req-182af714-3ca4-4095-aa99-0419124b40f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044126 Sep 06 16:22:48.578178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 400/828] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:48.727979 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:48.728744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:48.736438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:48.737239 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:48.738433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:48.739630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:48.740092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:48.740522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:48.777359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:48.777921 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:48.778355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:48.779019 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lazy-loading 'fault' on Instance uuid 736a6120-d82c-47e3-9565-163cdcc46d08 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:48.836345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:48.845355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-68f6293a-ff85-4c18-874b-c7425d7bd3e2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 200 len: 1332 microversion: 2.1 time: 0.122631 Sep 06 16:22:48.846269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 429/829] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:48 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:49.870992 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:49.871702 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:49.878392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:49.878914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:49.879356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:49.880067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:49.880523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:49.880952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:49.896185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 HTTP/1.1 Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:22:49.898016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:22:49.901263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '736a6120-d82c-47e3-9565-163cdcc46d08'} Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:22:49.902236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:22:49.904640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:22:49.907034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:22:49.907034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ecd778b0-846c-4d79-8998-0fde1f9d453a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 404 len: 111 microversion: 2.1 time: 0.034289 Sep 06 16:22:49.907034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 401/830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:49 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:22:49.909280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-283780cf-c4b5-4f76-be44-73eb81863320 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '.version_select at 0x7f21b804eb80>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:49.935616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-283780cf-c4b5-4f76-be44-73eb81863320 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669618949" status: 202 len: 0 microversion: 2.1 time: 0.030039 Sep 06 16:22:49.936107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 430/831] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Sep 6 16:22:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669618949 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:22:50.679524 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:50.680905 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:50.691549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:50.692039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:50.692486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:50.693220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:50.693675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:50.694106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:50.786162 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lazy-loading 'services' on Instance uuid 75eba83a-9a4e-46fb-854b-17e2f53a0444 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:50.869316 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c6f9fe99-4423-4f64-aedf-5b0cd39de941 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments/ff6ab4c7-bf0a-4d10-a165-d4d17b267927" status: 202 len: 0 microversion: 2.1 time: 0.193517 Sep 06 16:22:50.869894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 402/832] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:22:50 2022] DELETE /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments/ff6ab4c7-bf0a-4d10-a165-d4d17b267927 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:22:50.878387 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:50.880851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:50.888469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:50.889052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:50.889832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:50.890577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:50.891101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:50.891527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:50.924884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ca0ff166-6939-4ab4-aa3f-6184018227b0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050460 Sep 06 16:22:50.925646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 431/833] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:22:50 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:51.938325 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:51.940683 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:51.943150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:22:51.943298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Tue Sep 6 16:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments (ip 10.222.0.26) !!! Sep 06 16:22:51.944692 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:22:51.944692 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Tue Sep 6 16:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments (ip 10.222.0.26) !!! Sep 06 16:22:51.954420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:51.954932 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:51.955368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:51.956062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:51.956509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:51.956928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:51.991321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-15e6783a-2762-4869-8bf9-89ebe6acea4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057404 Sep 06 16:22:51.991875 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 403/834] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:22:51 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:53.004411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:53.006455 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:53.009188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:22:53.009338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Tue Sep 6 16:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments (ip 10.222.0.26) !!! Sep 06 16:22:53.018035 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.018526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.019009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:53.019718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.020179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.020609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:53.060853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7dc413fd-57da-4341-a46a-c833f2a838e0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060413 Sep 06 16:22:53.061593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 432/835] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:22:52 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:22:53.132492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:53.133048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:53.140351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.140841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.141276 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:53.141980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.142464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.142922 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:53.172627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:22:53.260690 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-abaccfce-aa50-498e-9ef8-0480db4b8678 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 204 len: 0 microversion: 2.1 time: 0.131588 Sep 06 16:22:53.262491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 404/836] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:22:53 2022] DELETE /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:22:53.270528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:53.271169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:53.277147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.277614 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.278039 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:53.278804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:53.279189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:53.279605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:53.422037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:53.431920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3a04002f-99fe-4630-b200-e00b278784e6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1681 microversion: 2.1 time: 0.164950 Sep 06 16:22:53.432529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 433/837] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:53 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:54.455982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:54.456677 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:54.463576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:54.464063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:54.464495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:54.465194 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:54.465646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:54.466066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:54.604593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:54.612914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-70dc411b-8bdc-4cd2-aaf6-b71057508c96 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1681 microversion: 2.1 time: 0.161071 Sep 06 16:22:54.613498 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 405/838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:54 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:22:55.501667 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-ad49a145-edfd-4c37-8df4-e9ab43e56836 req-af7cb7b5-af62-47f7-b004-a1bd3c331910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75eba83a-9a4e-46fb-854b-17e2f53a0444", "name": "network-vif-deleted", "tag": "287e2c73-e48f-47ca-97ed-0553597da139"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:55.512854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ad49a145-edfd-4c37-8df4-e9ab43e56836 req-af7cb7b5-af62-47f7-b004-a1bd3c331910 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.513340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ad49a145-edfd-4c37-8df4-e9ab43e56836 req-af7cb7b5-af62-47f7-b004-a1bd3c331910 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.513767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ad49a145-edfd-4c37-8df4-e9ab43e56836 req-af7cb7b5-af62-47f7-b004-a1bd3c331910 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.525700 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-ad49a145-edfd-4c37-8df4-e9ab43e56836 req-af7cb7b5-af62-47f7-b004-a1bd3c331910 service nova] Creating event network-vif-deleted:287e2c73-e48f-47ca-97ed-0553597da139 for instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 on hv-cinder-85220 Sep 06 16:22:55.532220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-ad49a145-edfd-4c37-8df4-e9ab43e56836 req-af7cb7b5-af62-47f7-b004-a1bd3c331910 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034053 Sep 06 16:22:55.536054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 434/839] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:22:55.636760 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:55.637424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:55.644442 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.645050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.645335 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.646359 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.646858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.647282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.699434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:55.700200 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:55.701081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:55.701784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lazy-loading 'fault' on Instance uuid 75eba83a-9a4e-46fb-854b-17e2f53a0444 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:22:55.756344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:55.765151 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8b217ef8-3db5-46a5-bbe0-9d3a1e6d017b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 200 len: 1331 microversion: 2.1 time: 0.132343 Sep 06 16:22:55.766066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 406/840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:55 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:22:56.790773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:56.791427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:56.797736 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:56.798220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:56.798683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:56.799374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:56.799828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:56.800255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:56.814390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 HTTP/1.1 Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:22:56.816191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:22:56.818090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '75eba83a-9a4e-46fb-854b-17e2f53a0444'} Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:22:56.819098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:22:56.821949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:22:56.823505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:22:56.823505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9c76a025-49ec-463e-bc77-335feed0912e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 404 len: 111 microversion: 2.1 time: 0.031857 Sep 06 16:22:56.823505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 435/841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:56 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:22:56.831683 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8606ba96-f4e1-4ef9-ae2b-94cafdcd93ff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '.version_select at 0x7f21bb894ee0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:56.866949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8606ba96-f4e1-4ef9-ae2b-94cafdcd93ff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317956596" status: 202 len: 0 microversion: 2.1 time: 0.042743 Sep 06 16:22:56.868172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 407/842] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Sep 6 16:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1317956596 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:22:57.594118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b38e42b6-be32-471b-bcca-c2ebcfe0c974 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: .version_select at 0x7f21b3f5aa60>, body: {"keypair": {"name": "tempest-keypair-1790383496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOibtD8YBEUGfYUqEKzzBxZNDaLov4t4VegR8gMQq6Rpllq63rSv8TwtMSXLCS5lcIxCncKAw9cZD5y9Iwy10uB5+ndEygdisBwL4mYKaZpgTVRGoPS0Yzxdb5izOGrotw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:57.611687 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-b38e42b6-be32-471b-bcca-c2ebcfe0c974 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:22:57.616329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-b38e42b6-be32-471b-bcca-c2ebcfe0c974 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:22:57.640839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b38e42b6-be32-471b-bcca-c2ebcfe0c974 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051008 Sep 06 16:22:57.641525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 436/843] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:22:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:22:59.032355 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1026822242", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5719a142-0389-455c-a92f-618471f11ba9"}], "security_groups": [{"name": "tempest-securitygroup--1745959693"}], "key_name": "tempest-keypair-1790383496", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:22:59.375625 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] validate_networks() for [('5719a142-0389-455c-a92f-618471f11ba9', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:22:59.776545 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:22:59.776998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:22:59.777508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:22:59.777949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:22:59.778364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:22:59.788191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:59.788673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:59.789156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:59.790468 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:22:59.790955 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:22:59.791385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:22:59.809765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:22:59.814242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:22:59.827584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:22:59.830110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:22:59.886041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0bd6b40d-f368-4f63-90fc-b45f854485fe tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.857972 Sep 06 16:22:59.886715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 408/844] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:22:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:22:59.899346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-22af9f47-63af-4318-aa5a-306be77cad05 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:22:59.900598 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-22af9f47-63af-4318-aa5a-306be77cad05 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:22:59.960187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-22af9f47-63af-4318-aa5a-306be77cad05 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:22:59.968679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-22af9f47-63af-4318-aa5a-306be77cad05 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1242 microversion: 2.1 time: 0.074620 Sep 06 16:22:59.969470 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 437/845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:22:59 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:00.992433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:00.992982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:00.999670 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:01.000217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:01.000682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:01.001376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:01.001835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:01.002271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:01.072092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:01.079846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4ce86536-e04f-43e7-9f85-ef8e85771d01 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1294 microversion: 2.1 time: 0.092061 Sep 06 16:23:01.080425 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 409/846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:00 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:02.106369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:02.107051 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:02.113945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:02.114781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:02.115227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:02.115982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:02.116442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:02.116869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:02.268155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:02.277504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-03f6bbb8-9f88-4d6e-89bf-43f54b5c47fb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.176054 Sep 06 16:23:02.278107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 438/847] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:02 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:02.782090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-4b01ddfb-f0d6-4a4d-9e04-03ad9cc486ab req-a53a9970-5fe1-419a-946c-6de00754f181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35", "tag": "54463ed2-ef2e-4bd8-a2a7-c6042656fa51"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:02.792989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4b01ddfb-f0d6-4a4d-9e04-03ad9cc486ab req-a53a9970-5fe1-419a-946c-6de00754f181 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:02.793762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4b01ddfb-f0d6-4a4d-9e04-03ad9cc486ab req-a53a9970-5fe1-419a-946c-6de00754f181 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:02.794250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4b01ddfb-f0d6-4a4d-9e04-03ad9cc486ab req-a53a9970-5fe1-419a-946c-6de00754f181 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:02.805798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-4b01ddfb-f0d6-4a4d-9e04-03ad9cc486ab req-a53a9970-5fe1-419a-946c-6de00754f181 service nova] Creating event network-changed:54463ed2-ef2e-4bd8-a2a7-c6042656fa51 for instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 on hv-cinder-85220 Sep 06 16:23:02.811026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-4b01ddfb-f0d6-4a4d-9e04-03ad9cc486ab req-a53a9970-5fe1-419a-946c-6de00754f181 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033132 Sep 06 16:23:02.811624 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 410/848] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:03.308425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:03.309178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:03.315719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:03.316210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:03.317410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:03.317410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:03.317792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:03.318219 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:03.460006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:03.468082 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a293251a-9147-43e0-9e00-1c85c84724b8 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.164618 Sep 06 16:23:03.468660 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 439/849] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:03 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:04.492643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:04.493349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:04.499576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:04.500066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:04.500507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:04.501202 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:04.501658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:04.502087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:04.639575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:04.647145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c2099998-ba41-4a92-bbea-842c9960b321 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.159206 Sep 06 16:23:04.647701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 411/850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:04 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:05.670472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:05.671085 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:05.677465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:05.677935 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:05.678362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:05.679076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:05.679522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:05.679939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:05.808579 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:05.816675 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2849746d-1418-4b98-8ee2-b013985375cd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.149971 Sep 06 16:23:05.817277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 440/851] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:05 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:06.841600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:06.842423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:06.848837 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:06.849316 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:06.849754 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:06.850440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:06.850915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:06.851337 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:07.107999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:07.116953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-93e4b255-a39a-47e2-9982-6548fc0db636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.280122 Sep 06 16:23:07.129628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 412/852] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:06 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:08.140311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:08.140926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:08.147497 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:08.148091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:08.148398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:08.149748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:08.150318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:08.150778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:08.291471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:08.299462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-38331a61-3bf9-47f6-92dd-b5c727cffdfd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.163007 Sep 06 16:23:08.300047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 441/853] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:08 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:09.210896 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-86ed31ca-578e-4b0b-873d-8eafb0371a35 req-709410f2-cd4b-46f9-9e09-11efc96e477a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35", "name": "network-vif-plugged", "status": "completed", "tag": "54463ed2-ef2e-4bd8-a2a7-c6042656fa51"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:09.222592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-86ed31ca-578e-4b0b-873d-8eafb0371a35 req-709410f2-cd4b-46f9-9e09-11efc96e477a service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.223438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-86ed31ca-578e-4b0b-873d-8eafb0371a35 req-709410f2-cd4b-46f9-9e09-11efc96e477a service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.223877 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-86ed31ca-578e-4b0b-873d-8eafb0371a35 req-709410f2-cd4b-46f9-9e09-11efc96e477a service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.228804 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:09.241292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-86ed31ca-578e-4b0b-873d-8eafb0371a35 req-709410f2-cd4b-46f9-9e09-11efc96e477a service nova] Creating event network-vif-plugged:54463ed2-ef2e-4bd8-a2a7-c6042656fa51 for instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 on hv-cinder-85220 Sep 06 16:23:09.247185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-86ed31ca-578e-4b0b-873d-8eafb0371a35 req-709410f2-cd4b-46f9-9e09-11efc96e477a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040189 Sep 06 16:23:09.247985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 413/854] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:09.324182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:09.324838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:09.331349 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.331835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.332272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.332966 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.333419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.333940 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.468112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:09.476009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-48251b76-feec-4022-b80e-c93b26162636 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.156661 Sep 06 16:23:09.476784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 442/855] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:09 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:09.671966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:09.672584 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:09.679402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.679894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.680342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.681038 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:09.681490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:09.682941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:09.765842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'services' on Instance uuid 1d89aa26-192e-4016-93ea-772996bb9e49 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:09.799571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:09.820623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:09.838704 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1feae9e1-3c8d-4da7-af1a-7c4fa55d71ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-volume_attachments/7481d48f-bfdb-4d91-8d82-3edcfec08894" status: 202 len: 0 microversion: 2.1 time: 0.170346 Sep 06 16:23:09.839306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 414/856] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:23:09 2022] DELETE /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-volume_attachments/7481d48f-bfdb-4d91-8d82-3edcfec08894 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:10.500346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:10.500958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:10.503108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:10.509066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:10.509556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:10.510577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:10.510890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:10.511354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:10.511800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:10.644070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:10.652850 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-18c92001-6e1a-4cdc-a16f-68becfa2ab91 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1368 microversion: 2.1 time: 0.156404 Sep 06 16:23:10.653418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 443/857] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:10 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:11.676936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:11.677629 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:11.684525 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.684997 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.685431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.686113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.686559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.687075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.817265 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:11.825676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-00e20650-0c60-4af3-87bf-79dd9eab79d1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1558 microversion: 2.1 time: 0.153481 Sep 06 16:23:11.826240 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 415/858] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:11 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:11.847996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:11.848515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:11.856094 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.856520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.856954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.857649 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:11.858098 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:11.858541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:11.936091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-189e4d29-5991-4f33-83f5-c45abb96e906 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091854 Sep 06 16:23:11.936712 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 444/859] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:23:11 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:12.939435 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-2100d0f6-9ece-437a-b1f5-74b4e55581c7 req-2ba10b0e-c4a2-4827-b6fc-95a35ff176d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35", "tag": "54463ed2-ef2e-4bd8-a2a7-c6042656fa51"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:12.950215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2100d0f6-9ece-437a-b1f5-74b4e55581c7 req-2ba10b0e-c4a2-4827-b6fc-95a35ff176d3 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:12.950719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2100d0f6-9ece-437a-b1f5-74b4e55581c7 req-2ba10b0e-c4a2-4827-b6fc-95a35ff176d3 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:12.951158 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-2100d0f6-9ece-437a-b1f5-74b4e55581c7 req-2ba10b0e-c4a2-4827-b6fc-95a35ff176d3 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:12.965225 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-2100d0f6-9ece-437a-b1f5-74b4e55581c7 req-2ba10b0e-c4a2-4827-b6fc-95a35ff176d3 service nova] Creating event network-changed:54463ed2-ef2e-4bd8-a2a7-c6042656fa51 for instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 on hv-cinder-85220 Sep 06 16:23:12.971329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-2100d0f6-9ece-437a-b1f5-74b4e55581c7 req-2ba10b0e-c4a2-4827-b6fc-95a35ff176d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035346 Sep 06 16:23:12.972244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 416/860] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:13.107493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-67b933ef-3108-453d-992f-a6c0147b62d7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:13.113954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67b933ef-3108-453d-992f-a6c0147b62d7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:13.114440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67b933ef-3108-453d-992f-a6c0147b62d7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:13.115088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67b933ef-3108-453d-992f-a6c0147b62d7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:13.148020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-67b933ef-3108-453d-992f-a6c0147b62d7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Going to try to stop instance {{(pid=120739) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 16:23:13.192377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:13.206598 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-67b933ef-3108-453d-992f-a6c0147b62d7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action" status: 202 len: 0 microversion: 2.1 time: 0.104042 Sep 06 16:23:13.210400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 445/861] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:23:13 2022] POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:23:13.217359 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:13.218090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:13.232387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:13.233119 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:13.233647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:13.234455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:13.235032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:13.235693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:13.552062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:13.567440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f5808e6d-ae77-4a71-8ebf-c95f2bbd5061 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.354650 Sep 06 16:23:13.568658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 417/862] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:13 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:14.594735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:14.595440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:14.603129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.603947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.604547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.605251 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:14.605707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:14.606164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:14.735577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:14.743247 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-84cca706-5688-40bd-ae16-0b5be1ee42aa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.153577 Sep 06 16:23:14.743817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 446/863] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:14 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:15.767289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:15.767900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:15.770302 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:15.776186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.776802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.777242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.777951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:15.778401 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:15.778864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:15.918117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:15.926019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2bb79990-241b-4132-b2ed-690d26c75a2a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.162547 Sep 06 16:23:15.926595 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 418/864] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:15 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:16.950474 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:16.951065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:16.953727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:16.960206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.960692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.961130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:16.961859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:16.962314 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:16.962759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:17.107230 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:17.115248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7333317d-f1cb-4125-835f-66b52e881956 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.169511 Sep 06 16:23:17.115833 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 447/865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:16 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:18.139663 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:18.140272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:18.146914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:18.147390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:18.147825 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:18.148513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:18.148964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:18.149388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:18.280517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:18.291261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cb3c5b5a-b68f-4ad0-9a8a-c947428491ae tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.156191 Sep 06 16:23:18.291785 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 419/866] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:18 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:19.316228 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:19.316904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:19.323640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.324158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.324609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.325420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:19.325882 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:19.326308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:19.460263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:19.469760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a6c0a8e4-ff50-4b3a-9313-fa8816492572 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.157449 Sep 06 16:23:19.470342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 448/867] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:19 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:20.493767 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:20.494322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:20.502441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:20.502959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:20.503399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:20.504100 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:20.504557 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:20.504977 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:20.644057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:20.651897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-93d5b6d5-f9ba-4967-a6fa-ff3bf55d1b35 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.162161 Sep 06 16:23:20.652678 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 420/868] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:20 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:21.674922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:21.675826 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:21.683203 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:21.683723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:21.684292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:21.684981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:21.685435 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:21.685891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:21.828027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:21.841521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e443d83-7e77-4298-8b91-db52600e9f51 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.169968 Sep 06 16:23:21.842596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 449/869] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:21 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:22.869641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:22.870281 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:22.877282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:22.877765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:22.878201 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:22.878931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:22.879412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:22.879855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:23.016285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:23.024292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-57ba428d-be2a-418f-81ca-51038540969f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1675 microversion: 2.1 time: 0.158642 Sep 06 16:23:23.024802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 421/870] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:22 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:24.048809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:24.049682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:24.056760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:24.057234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:24.057661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:24.058345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:24.059234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:24.065660 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:24.197337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:24.205535 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2fbf19a3-00a4-4d31-9eec-1b4433b4e65f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1652 microversion: 2.1 time: 0.160568 Sep 06 16:23:24.206101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 450/871] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:24 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1652 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:24.229145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-63fb704a-128f-47c8-ab8c-f63353de5ed1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:24.236748 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63fb704a-128f-47c8-ab8c-f63353de5ed1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:24.237234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63fb704a-128f-47c8-ab8c-f63353de5ed1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:24.237668 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63fb704a-128f-47c8-ab8c-f63353de5ed1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:24.302416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-63fb704a-128f-47c8-ab8c-f63353de5ed1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Going to try to start instance {{(pid=120738) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 16:23:24.349455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-63fb704a-128f-47c8-ab8c-f63353de5ed1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action" status: 202 len: 0 microversion: 2.1 time: 0.123957 Sep 06 16:23:24.350078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 422/872] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:23:24 2022] POST /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:24.359429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:24.360043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:24.366293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:24.366807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:24.367292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:24.367993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:24.368449 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:24.368882 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:24.516887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:24.525043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ca65fd30-91ec-4d1e-8395-213c176a3737 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1661 microversion: 2.1 time: 0.170182 Sep 06 16:23:24.525841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 451/873] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:24 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:25.549306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:25.550046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:25.556943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:25.557437 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:25.557873 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:25.559096 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:25.559548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:25.559972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:25.721268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:25.729998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2ae5c32a-beff-4d94-8e2d-4008b4c927fa tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1661 microversion: 2.1 time: 0.184936 Sep 06 16:23:25.731259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 423/874] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:25 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1661 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:26.206620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1507742576"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:26.207252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:26.213848 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:26.214333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:26.215411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:26.216730 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:26.217183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:26.217641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:26.373317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.network.security_group_api [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Removing security group bd938232-ed0c-4ef8-a3c0-d73839a6ce27 from port 602703ac-73bc-4d76-8d30-7fc671f1225e Sep 06 16:23:26.701069 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d7233a64-d08c-40e1-b6e3-22e2e6f8010f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/action" status: 202 len: 0 microversion: 2.1 time: 0.498316 Sep 06 16:23:26.701695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 452/875] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:23:26 2022] POST /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:26.712744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-117561f9-3246-4132-84fc-8f3d400bf9c1 req-98baa099-c238-443d-a8a7-589ded1c256a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c69f8-26fd-4b9a-900d-11a0dc0e22b8", "tag": "602703ac-73bc-4d76-8d30-7fc671f1225e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:26.733369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-117561f9-3246-4132-84fc-8f3d400bf9c1 req-98baa099-c238-443d-a8a7-589ded1c256a service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:26.734165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-117561f9-3246-4132-84fc-8f3d400bf9c1 req-98baa099-c238-443d-a8a7-589ded1c256a service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:26.736200 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-117561f9-3246-4132-84fc-8f3d400bf9c1 req-98baa099-c238-443d-a8a7-589ded1c256a service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:26.755776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-117561f9-3246-4132-84fc-8f3d400bf9c1 req-98baa099-c238-443d-a8a7-589ded1c256a service nova] Creating event network-changed:602703ac-73bc-4d76-8d30-7fc671f1225e for instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 on hv-cinder-85220 Sep 06 16:23:26.757074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:26.757800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:26.764919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:26.767206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-117561f9-3246-4132-84fc-8f3d400bf9c1 req-98baa099-c238-443d-a8a7-589ded1c256a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056866 Sep 06 16:23:26.769982 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 424/876] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:26.772436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:26.772898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:26.774060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:26.774733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:26.775367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:26.972048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:26.981305 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c4f5c035-24c5-4f5e-bc42-6751bbc2d688 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1665 microversion: 2.1 time: 0.228425 Sep 06 16:23:26.997296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 453/877] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:26 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1665 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:28.275988 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:28.276661 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:28.283780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:28.284372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:28.284884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:28.285656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:28.286191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:28.286714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:28.371250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lazy-loading 'services' on Instance uuid 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:28.470171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4610e732-db26-41fe-a6cd-b738934b5d6e tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments/b82129ae-c411-4526-ac7f-3c58f03b0c04" status: 202 len: 0 microversion: 2.1 time: 0.198815 Sep 06 16:23:28.470796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 425/878] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:23:28 2022] DELETE /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments/b82129ae-c411-4526-ac7f-3c58f03b0c04 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:23:28.483264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:28.486556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:28.497031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:28.497577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:28.498021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:28.498894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:28.499558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:28.499991 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:28.535053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6395f54b-1cc7-4614-9081-beca41be1e70 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059613 Sep 06 16:23:28.535641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 454/879] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:28 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:28.785900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-5de0f3fd-8668-4ecb-b23a-022b35153f5e req-c5581e77-68a2-4f56-ba49-0346a2fcbeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570c69f8-26fd-4b9a-900d-11a0dc0e22b8", "tag": "602703ac-73bc-4d76-8d30-7fc671f1225e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:28.796583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5de0f3fd-8668-4ecb-b23a-022b35153f5e req-c5581e77-68a2-4f56-ba49-0346a2fcbeef service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:28.797064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5de0f3fd-8668-4ecb-b23a-022b35153f5e req-c5581e77-68a2-4f56-ba49-0346a2fcbeef service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:28.797497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5de0f3fd-8668-4ecb-b23a-022b35153f5e req-c5581e77-68a2-4f56-ba49-0346a2fcbeef service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:28.808928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-5de0f3fd-8668-4ecb-b23a-022b35153f5e req-c5581e77-68a2-4f56-ba49-0346a2fcbeef service nova] Creating event network-changed:602703ac-73bc-4d76-8d30-7fc671f1225e for instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 on hv-cinder-85220 Sep 06 16:23:28.814115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-5de0f3fd-8668-4ecb-b23a-022b35153f5e req-c5581e77-68a2-4f56-ba49-0346a2fcbeef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Sep 06 16:23:28.814755 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 426/880] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:29.549116 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:29.551408 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:29.558578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:29.558821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:29.559268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:29.559989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:29.560463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:29.560890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:29.595761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-68076ae3-ca19-4aa0-ac16-3ebaa45eeec1 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050692 Sep 06 16:23:29.596612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 455/881] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:29 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:30.611330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:30.613560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:30.619886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.620371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.620813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.621515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.622070 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.622503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.661503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d16417e2-79e0-4e83-ad66-8eee96b10b0f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055691 Sep 06 16:23:30.662094 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 427/882] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:30 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:23:30.674015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:30.674714 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:30.682040 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.682720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.683238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.684159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:30.684454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:30.685032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:30.770193 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] HTTP exception thrown: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 is not attached to volume b82129ae-c411-4526-ac7f-3c58f03b0c04 Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Request method failure captured: Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments/b82129ae-c411-4526-ac7f-3c58f03b0c04 HTTP/1.1 Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3JsKre3w9VGAZODafPP2JRaZU0xWZo9hl3qvAGfSrgAb87AWdPJA6mHPWpcRj7wUZ7oMS6XtZF9tE0kdkamWJu5rOeQfabwUETkC7NXvHxqSwXAMnoIyS5PWvGxYQKqqHKOIVNldJBBmwJiAssgtMUng1qFesZwQVKnCUM0qpb3G4g Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: fbc78793ec5c47aa9b56c6cbe6c4d9dc Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestMinimumBasicScenario-1249938207 Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:23:30.772611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestMinimumBasicScenario-1249938207 Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: fbc78793ec5c47aa9b56c6cbe6c4d9dc Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1249938207 Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-TestMinimumBasicScenario-1249938207-project Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: ac26eb671f1a4a889e8d9c7c35a70019 Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestMinimumBasicScenario-1249938207-project Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:23:30.774279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 is not attached to volume b82129ae-c411-4526-ac7f-3c58f03b0c04 Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'server_id': '570c69f8-26fd-4b9a-900d-11a0dc0e22b8', 'id': 'b82129ae-c411-4526-ac7f-3c58f03b0c04'} Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b82129ae-c411-4526-ac7f-3c58f03b0c04. Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:23:30.775256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 is not attached to volume b82129ae-c411-4526-ac7f-3c58f03b0c04 Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 is not attached to volume b82129ae-c411-4526-ac7f-3c58f03b0c04 Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:30.776799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Returning 404 to user: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 is not attached to volume b82129ae-c411-4526-ac7f-3c58f03b0c04 {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:23:30.778034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0f2896eb-2a95-427f-863b-bc6170b4fb9f tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments/b82129ae-c411-4526-ac7f-3c58f03b0c04" status: 404 len: 154 microversion: 2.1 time: 0.104849 Sep 06 16:23:30.778034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 456/883] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:23:30 2022] DELETE /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8/os-volume_attachments/b82129ae-c411-4526-ac7f-3c58f03b0c04 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:23:31.937067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:31.937621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:31.944722 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:31.945347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:31.945791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:31.946497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:31.946974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:31.947654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:31.974485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:23:32.024708 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:32.063378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-74fe8bf9-f3e5-448f-aa75-29f8671ca9a7 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 204 len: 0 microversion: 2.1 time: 0.130354 Sep 06 16:23:32.064065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 428/884] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:23:31 2022] DELETE /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:23:32.074148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:32.074895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:32.081668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:32.082146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:32.082578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:32.083311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:32.083751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:32.084165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:32.225006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:32.234297 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-45c6f120-91ea-4661-92c1-36408763a170 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1555 microversion: 2.1 time: 0.164241 Sep 06 16:23:32.234900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 457/885] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:32 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:33.259455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:33.260273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:33.267467 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:33.267959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:33.268419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:33.269131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:33.269577 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:33.269999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:33.667175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:33.678241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2a0cc8ad-33fd-4541-9276-4ad1fc429e79 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1555 microversion: 2.1 time: 0.423578 Sep 06 16:23:33.679070 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 429/886] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:33 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1555 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:33.976692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b85049cf-64cd-47b3-b3a1-39b8ae155b8b req-d23246fb-561d-472a-80c8-8efb958055bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570c69f8-26fd-4b9a-900d-11a0dc0e22b8", "name": "network-vif-deleted", "tag": "602703ac-73bc-4d76-8d30-7fc671f1225e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:33.988439 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b85049cf-64cd-47b3-b3a1-39b8ae155b8b req-d23246fb-561d-472a-80c8-8efb958055bd service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:33.988918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b85049cf-64cd-47b3-b3a1-39b8ae155b8b req-d23246fb-561d-472a-80c8-8efb958055bd service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:33.989354 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b85049cf-64cd-47b3-b3a1-39b8ae155b8b req-d23246fb-561d-472a-80c8-8efb958055bd service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.004370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b85049cf-64cd-47b3-b3a1-39b8ae155b8b req-d23246fb-561d-472a-80c8-8efb958055bd service nova] Creating event network-vif-deleted:602703ac-73bc-4d76-8d30-7fc671f1225e for instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 on hv-cinder-85220 Sep 06 16:23:34.010952 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b85049cf-64cd-47b3-b3a1-39b8ae155b8b req-d23246fb-561d-472a-80c8-8efb958055bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037456 Sep 06 16:23:34.011577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 458/887] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:34.706623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:34.707325 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:34.713953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.714446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.715309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.716029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.716493 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.717009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.755871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:34.756362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:34.756799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:34.757257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lazy-loading 'fault' on Instance uuid 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:34.806235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac26eb671f1a4a889e8d9c7c35a70019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc78793ec5c47aa9b56c6cbe6c4d9dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:34.820896 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f9c4794d-5398-42ee-971e-e9683e16d1ff tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 200 len: 1349 microversion: 2.1 time: 0.118245 Sep 06 16:23:34.821699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 430/888] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:34 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 1349 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:35.847081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:35.847802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] [instance: 570c69f8-26fd-4b9a-900d-11a0dc0e22b8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:35.855092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.855515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.856075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.856802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:35.857260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:35.857692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:35.872408 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] HTTP exception thrown: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 could not be found. Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Request method failure captured: Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 HTTP/1.1 Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3JsKre3w9VGAZODafPP2JRaZU0xWZo9hl3qvAGfSrgAb87AWdPJA6mHPWpcRj7wUZ7oMS6XtZF9tE0kdkamWJu5rOeQfabwUETkC7NXvHxqSwXAMnoIyS5PWvGxYQKqqHKOIVNldJBBmwJiAssgtMUng1qFesZwQVKnCUM0qpb3G4g Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: fbc78793ec5c47aa9b56c6cbe6c4d9dc Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestMinimumBasicScenario-1249938207 Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:23:35.874111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fbc78793ec5c47aa9b56c6cbe6c4d9dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestMinimumBasicScenario-1249938207 Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: fbc78793ec5c47aa9b56c6cbe6c4d9dc Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1249938207 Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-TestMinimumBasicScenario-1249938207-project Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: ac26eb671f1a4a889e8d9c7c35a70019 Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestMinimumBasicScenario-1249938207-project Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 could not be found. Sep 06 16:23:35.875496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '570c69f8-26fd-4b9a-900d-11a0dc0e22b8'} Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 could not be found. Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:23:35.876521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 could not be found. Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 could not be found. Sep 06 16:23:35.878316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:35.879734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Returning 404 to user: Instance 570c69f8-26fd-4b9a-900d-11a0dc0e22b8 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:23:35.879734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-07ee4c29-1085-48b0-b4f9-7d5ec3a602bc tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8" status: 404 len: 111 microversion: 2.1 time: 0.033015 Sep 06 16:23:35.879734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 459/889] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:35 2022] GET /compute/v2.1/servers/570c69f8-26fd-4b9a-900d-11a0dc0e22b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:23:35.885579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f1671e0e-b097-4962-8bf1-65739f9d4253 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] Calling method '.version_select at 0x7f21b3f485e0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:35.908771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f1671e0e-b097-4962-8bf1-65739f9d4253 tempest-TestMinimumBasicScenario-1249938207 tempest-TestMinimumBasicScenario-1249938207-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1948053589" status: 202 len: 0 microversion: 2.1 time: 0.026990 Sep 06 16:23:35.909371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 431/890] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Sep 6 16:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1948053589 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:45.976264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:45.976847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:45.979295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=25 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:45.980035 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=74 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:45.986330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:45.986998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:45.987506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:45.988209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:45.988668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:45.989093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:46.097505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lazy-loading 'services' on Instance uuid dabc80db-90dc-4ac2-85a4-d86a4e2506e3 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:46.174741 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e8c90478-3ef8-4121-8fd6-59593f3ca7ff tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments/a376f376-f758-431f-9589-155f5a050712" status: 202 len: 0 microversion: 2.1 time: 0.201885 Sep 06 16:23:46.175277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 460/891] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:23:45 2022] DELETE /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments/a376f376-f758-431f-9589-155f5a050712 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:46.181424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:46.183101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:46.190259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:46.194133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:46.208973 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:46.209768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:46.210579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:46.211881 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:46.212706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:46.213490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:46.251600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1f6963c2-6b6f-4781-83e6-d25acfa9b03e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071473 Sep 06 16:23:46.252196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 432/892] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:46 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:23:47.194256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:47.197001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:47.203579 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.204086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.204524 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.205243 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.205700 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.206128 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.233299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lazy-loading 'flavor' on Instance uuid fdc7093e-ac27-4690-84d8-033d4912129e {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:47.267963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:47.270441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:47.280516 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.281489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.282058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.283744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.284777 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.286129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.348739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ba163faf-9dcc-4b2d-8c3f-14be2c1cfcea tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086021 Sep 06 16:23:47.350303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 433/893] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:23:47 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 16:23:47.352085 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d78716a1-3020-4cba-920c-32f2338c0829 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "POST /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e/action" status: 202 len: 0 microversion: 2.1 time: 0.439958 Sep 06 16:23:47.356569 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 461/894] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:23:46 2022] POST /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:47.366807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:47.368150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:47.377339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.378155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.378944 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.379938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.380475 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.381272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.488549 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:47.489132 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:47.495772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.496263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.496830 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.497827 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.498725 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.499331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.529948 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:23:47.572227 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:47.584247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-90189a15-a9cd-4996-b3e4-ac62edee5629 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.225964 Sep 06 16:23:47.584850 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 434/895] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:47 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:47.630314 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-222526a1-fee6-4f7a-b9e7-aa1a9aace0b8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 204 len: 0 microversion: 2.1 time: 0.145847 Sep 06 16:23:47.631079 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 462/896] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:23:47 2022] DELETE /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:23:47.640488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:47.641117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:47.647630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.648126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.648566 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.649290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:47.649750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:47.650328 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:47.804555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:47.824835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a0c0f5ff-fb6f-4dd8-b07f-b5b47ebd5b41 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1687 microversion: 2.1 time: 0.187386 Sep 06 16:23:47.825781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 435/897] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:47 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:48.616903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:48.617617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:48.624901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:48.625384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:48.625818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:48.626520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:48.626992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:48.627412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:48.765756 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:48.774105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-91e964fd-e8de-4f83-a2d4-d50aa222d482 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.161433 Sep 06 16:23:48.774726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 463/898] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:48 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:48.850199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:48.850827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:48.858771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:48.859199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:48.859645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:48.860360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:48.860816 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:48.861244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:49.004426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:49.017756 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a08885f4-7c42-448d-8816-efcf7991e042 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1687 microversion: 2.1 time: 0.171263 Sep 06 16:23:49.018341 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 436/899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:48 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:49.797567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:49.798151 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:49.804567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:49.805125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:49.805468 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:49.806142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:49.806581 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:49.807099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:49.938435 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:49.946073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0d4e87c0-b6fc-43e8-a128-fce3043f629f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.152392 Sep 06 16:23:49.946636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 464/900] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:49 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:50.041495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:50.042109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:50.048701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:50.049188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:50.049628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:50.050337 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:50.050831 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:50.051263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:50.197179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:50.206117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0c643d84-b474-4757-ae69-71ce57f2011e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1687 microversion: 2.1 time: 0.168563 Sep 06 16:23:50.206714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 437/901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:50 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:50.970894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:50.971655 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:50.978346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:50.978875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:50.979309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:50.980122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:50.981255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:50.981874 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:51.138215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:51.146481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-731095df-d5d2-4e11-a129-696ab020955f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.179386 Sep 06 16:23:51.147075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 465/902] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:50 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:51.234152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:51.234152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:51.239423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:51.239950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:51.240389 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:51.241103 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:51.241559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:51.241987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:51.487127 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:51.495624 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5a46e37f-56cb-4f4f-8a52-2acb2063b801 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1687 microversion: 2.1 time: 0.267905 Sep 06 16:23:51.497305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 438/903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:51 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1687 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:51.894736 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-4df0af33-abee-4428-82a1-fcc4e7a522bd req-bb47b911-59ac-4ae3-af52-6e7cd7d94819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabc80db-90dc-4ac2-85a4-d86a4e2506e3", "name": "network-vif-deleted", "tag": "1c51f956-0113-45f5-b6b4-fe6b787d4b5a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:51.907790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4df0af33-abee-4428-82a1-fcc4e7a522bd req-bb47b911-59ac-4ae3-af52-6e7cd7d94819 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:51.908256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4df0af33-abee-4428-82a1-fcc4e7a522bd req-bb47b911-59ac-4ae3-af52-6e7cd7d94819 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:51.908897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4df0af33-abee-4428-82a1-fcc4e7a522bd req-bb47b911-59ac-4ae3-af52-6e7cd7d94819 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:51.922900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-4df0af33-abee-4428-82a1-fcc4e7a522bd req-bb47b911-59ac-4ae3-af52-6e7cd7d94819 service nova] Creating event network-vif-deleted:1c51f956-0113-45f5-b6b4-fe6b787d4b5a for instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 on hv-cinder-85220 Sep 06 16:23:51.932133 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-4df0af33-abee-4428-82a1-fcc4e7a522bd req-bb47b911-59ac-4ae3-af52-6e7cd7d94819 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040923 Sep 06 16:23:51.933302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 466/904] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:23:52.171002 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:52.172134 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:52.178754 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:52.179252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:52.179686 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:52.180402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:52.180851 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:52.181550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:52.360968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:52.376455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-07fce06c-d62a-4dc3-803f-f735bd8031f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.210118 Sep 06 16:23:52.377569 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 439/905] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:52 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:52.521511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:52.522201 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:52.529248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:52.529665 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:52.530118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:52.530824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:52.531274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:52.531690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:52.565389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:52.565774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:52.566204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:52.566681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lazy-loading 'fault' on Instance uuid dabc80db-90dc-4ac2-85a4-d86a4e2506e3 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:23:52.622280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:52.630014 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-529d9654-e838-498d-9da2-7823b1cf0cdb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 200 len: 1333 microversion: 2.1 time: 0.112594 Sep 06 16:23:52.630607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 467/906] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:52 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 1333 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:53.401705 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:53.402364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:53.408877 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:53.409406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:53.409879 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:53.410626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:53.411144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:53.411630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:53.548856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:53.556884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3ea024e7-d27f-4c0b-a78e-d81ceb407a7b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.159729 Sep 06 16:23:53.557455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 440/907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:53 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:53.656032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:53.656565 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: dabc80db-90dc-4ac2-85a4-d86a4e2506e3] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:53.662905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:53.663375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:53.663809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:53.664482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:53.664925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:53.665340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:53.679200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] HTTP exception thrown: Instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 could not be found. Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Request method failure captured: Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 HTTP/1.1 Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Hdgju97tQEPcRdHdLythvqGQSY2DsXgDVo-YwRbq86iiMwtEfs6p6WVIpgQQ8HXRst0XJLhtYylMq_O5tsHQdLVoaQvn0nvFuENdKxQ84q_KS_BHm6PtliV88UEis-RxvqrCTOwCt9tSKsl1IrIL-zmidECL4F0XaB00VFksv30dQ Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:23:53.680846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: eda6839efaab4317a0eda1f47f1656a2 Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 could not be found. Sep 06 16:23:53.682482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'dabc80db-90dc-4ac2-85a4-d86a4e2506e3'} Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 could not be found. Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:23:53.684229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 could not be found. Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 could not be found. Sep 06 16:23:53.685764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:23:53.687145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Returning 404 to user: Instance dabc80db-90dc-4ac2-85a4-d86a4e2506e3 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:23:53.687145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d569850c-13c0-436d-92ac-628af2668cc2 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3" status: 404 len: 111 microversion: 2.1 time: 0.030278 Sep 06 16:23:53.687145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 468/908] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:53 2022] GET /compute/v2.1/servers/dabc80db-90dc-4ac2-85a4-d86a4e2506e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:23:53.692129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-708cec84-424b-467a-9517-cb6114708867 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '.version_select at 0x7f21b80e1af0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:53.711339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-708cec84-424b-467a-9517-cb6114708867 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-98580497" status: 202 len: 0 microversion: 2.1 time: 0.023095 Sep 06 16:23:53.711906 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 441/909] 10.222.0.26 () {58 vars in 1215 bytes} [Tue Sep 6 16:23:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-98580497 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:23:54.581693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:54.582308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:54.588893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:54.589381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:54.591153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:54.591876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:54.592335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:54.592759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:54.734551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:54.742499 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d21c59f6-5803-4f94-8ef7-19306978affa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.164750 Sep 06 16:23:54.743114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 469/910] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:54 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:23:55.768104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:55.768734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:55.776050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:55.776532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:55.777577 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:55.778395 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:55.778875 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:55.779355 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:55.940758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:55.955656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-447ae8cd-b8bf-496d-8dc3-7131ed1038ec tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.191342 Sep 06 16:23:55.956639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 442/911] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:55 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:56.661441 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:56.662123 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:56.669338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:56.669829 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:56.670264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:56.670993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:56.671439 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:56.671859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:56.698695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:23:56.786798 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c55c1f44-0226-4ad0-a4d8-62d6547b8b0e tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 204 len: 0 microversion: 2.1 time: 0.128716 Sep 06 16:23:56.787358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 470/912] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:23:56 2022] DELETE /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 16:23:56.796371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:56.797117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:56.804008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:56.804504 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:56.804950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:56.805670 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:56.806131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:56.806566 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:56.958274 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:56.967597 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-30210be5-441e-47d1-b6eb-3954917d16f1 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1506 microversion: 2.1 time: 0.175131 Sep 06 16:23:56.968195 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 443/913] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:56 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:56.981068 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:56.981994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:56.990000 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:56.990753 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:56.991438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:56.992394 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:56.993117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:56.994014 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:57.016885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:23:57.159313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:57.167705 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-85a5e25e-83b9-4278-bbf9-5a5a90d6d2c9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.191567 Sep 06 16:23:57.168296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 471/914] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:56 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:57.992270 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:57.992890 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:58.000320 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:58.000867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:58.001314 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:58.002113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:58.003432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:58.003864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:58.191749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:58.192516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:58.199835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:58.200438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:58.200992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:58.201945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:58.202473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:58.203011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:58.367237 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:58.377100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cbcdea7b-a2cb-439e-a7bd-dffe9beefcf1 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.189193 Sep 06 16:23:58.377696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 472/915] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:58 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:58.569264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:58.577930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-14d09275-d737-4bb1-a72d-fdad3d05cde0 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1506 microversion: 2.1 time: 0.589809 Sep 06 16:23:58.578525 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 444/916] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:57 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:59.100425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-70dcfda5-99d5-41e3-96f3-92c897391c3c req-e0f559bd-c71e-4ffe-a9d7-c3b4700ee668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbd0bbd-012b-4497-a8e2-247e7cfd22cd", "name": "network-vif-deleted", "tag": "238bad90-5526-4449-82a2-c985d1021f8a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:23:59.116134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-70dcfda5-99d5-41e3-96f3-92c897391c3c req-e0f559bd-c71e-4ffe-a9d7-c3b4700ee668 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:59.116878 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-70dcfda5-99d5-41e3-96f3-92c897391c3c req-e0f559bd-c71e-4ffe-a9d7-c3b4700ee668 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:59.117306 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-70dcfda5-99d5-41e3-96f3-92c897391c3c req-e0f559bd-c71e-4ffe-a9d7-c3b4700ee668 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:59.130179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-70dcfda5-99d5-41e3-96f3-92c897391c3c req-e0f559bd-c71e-4ffe-a9d7-c3b4700ee668 service nova] Creating event network-vif-deleted:238bad90-5526-4449-82a2-c985d1021f8a for instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd on hv-cinder-85220 Sep 06 16:23:59.135869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-70dcfda5-99d5-41e3-96f3-92c897391c3c req-e0f559bd-c71e-4ffe-a9d7-c3b4700ee668 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042086 Sep 06 16:23:59.136928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 473/917] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:23:59.415162 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:59.415774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:59.423306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:59.423800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:59.424463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:59.425367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:59.426009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:59.426450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:59.580907 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:59.591875 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ffe347bf-e50b-4f50-bed8-98f53f955f74 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.180507 Sep 06 16:23:59.592451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 445/918] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:59 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:23:59.603111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:23:59.603892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:23:59.611532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:59.611906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:59.612341 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:59.613045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:23:59.613494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:23:59.613910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:23:59.681573 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:23:59.689673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9566d57d-1e1e-4957-a9b7-cc7d09b129e8 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1293 microversion: 2.1 time: 0.090865 Sep 06 16:23:59.690257 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 474/919] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:23:59 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:00.616151 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:00.616771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:00.623869 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:00.624357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:00.624794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:00.625496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:00.625956 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:00.626390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:00.713380 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:00.714125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:00.721454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:00.721940 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:00.722376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:00.723438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:00.723899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:00.724319 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:00.775794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:00.777696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:00.778611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:00.778904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lazy-loading 'fault' on Instance uuid 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:24:00.787382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:00.798082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-34c1295a-2915-41fb-b9cb-33da3b70529d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.186141 Sep 06 16:24:00.808206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 446/920] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:00 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:00.826180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:00.837141 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dfe9962d-f08f-44e9-921f-e0686c3eef9a tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 200 len: 1312 microversion: 2.1 time: 0.127541 Sep 06 16:24:00.838159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 475/921] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:00 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:01.840402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:01.841191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:01.848044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:01.848543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:01.848983 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:01.849700 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:01.850156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:01.850703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:01.875308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:01.875947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:01.882891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:01.883391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:01.883830 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:01.884556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:01.885012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:01.885654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:01.904787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] HTTP exception thrown: Instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd could not be found. Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Request method failure captured: Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd HTTP/1.1 Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Hdgju97tQEPcRdHdLythvqGQSY2DsXgDVo-YwRbq86iiMwtEfs6p6WVIpgQQ8HXRst0XJLhtYylMq_O5tsHQdLVoaQvn0nvFuENdKxQ84q_KS_BHm6PtliV88UEis-RxvqrCTOwCt9tSKsl1IrIL-zmidECL4F0XaB00VFksv30dQ Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:24:01.906885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: eda6839efaab4317a0eda1f47f1656a2 Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd could not be found. Sep 06 16:24:01.909791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '7fbd0bbd-012b-4497-a8e2-247e7cfd22cd'} Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd could not be found. Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:24:01.911391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd could not be found. Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd could not be found. Sep 06 16:24:01.913290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:01.915461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Returning 404 to user: Instance 7fbd0bbd-012b-4497-a8e2-247e7cfd22cd could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:24:01.915461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c625489c-cc8c-437b-ad5d-05fb3a309931 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd" status: 404 len: 111 microversion: 2.1 time: 0.037813 Sep 06 16:24:01.915461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 476/922] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:01 2022] GET /compute/v2.1/servers/7fbd0bbd-012b-4497-a8e2-247e7cfd22cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:24:01.921284 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:01.921782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:01.928495 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:01.928995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:01.929433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:01.930144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:01.930596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:01.931123 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:01.975810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:24:02.050955 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:02.061688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ee213806-9bc1-474a-a79e-4e8d1c0f42d7 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1568 microversion: 2.1 time: 0.225912 Sep 06 16:24:02.062280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 447/923] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:01 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:02.088675 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7c1caf2e-98d2-4e02-8fcd-a0e09277ea7f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 204 len: 0 microversion: 2.1 time: 0.171113 Sep 06 16:24:02.088675 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 477/924] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:24:01 2022] DELETE /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:24:02.093674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:02.095247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:02.103637 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:02.104808 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:02.106101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:02.107156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:02.108278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:02.109743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:02.110781 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:02.111491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:02.115551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:02.116345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:02.117059 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:02.118091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:02.118642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:02.119234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:02.163911 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120738) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 16:24:02.211507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:02.244577 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6a83676b-f33d-4dde-989a-1c3d9d1945ee tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "POST /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e/action" status: 202 len: 0 microversion: 2.1 time: 0.159335 Sep 06 16:24:02.248477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 448/925] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 6 16:24:02 2022] POST /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:24:02.253709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:02.254376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:02.261156 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:02.261651 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:02.262133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:02.262875 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:02.263503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:02.263933 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:02.283453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:02.296441 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-251e8595-80b7-434c-8ac1-8397d8ebc64f tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.200060 Sep 06 16:24:02.297260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 478/926] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:02 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:02.412854 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:02.421955 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e3a01fe1-5786-4b60-92ab-a0f136fd2b46 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1516 microversion: 2.1 time: 0.172223 Sep 06 16:24:02.422535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 449/927] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:02 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:03.320382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:03.320994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:03.329599 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:03.330342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:03.331718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:03.332428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:03.332885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:03.333520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:03.446259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:03.447066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:03.453783 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:03.454421 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:03.455017 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:03.455827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:03.456386 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:03.456918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:03.469995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:03.478515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-733b1e7d-1535-4bca-8a5f-1d8b2fe95acb tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1521 microversion: 2.1 time: 0.161653 Sep 06 16:24:03.479133 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 479/928] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:03 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:03.655515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:03.665068 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1502c277-1313-4d6a-8152-8350b12b81aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1518 microversion: 2.1 time: 0.222598 Sep 06 16:24:03.665874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 450/929] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:03 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:03.763435 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-1ca39b6a-97ff-487f-b6e4-75edaafeb8b9 req-d0a324e7-7c53-4140-be93-74b41d88f29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc7093e-ac27-4690-84d8-033d4912129e", "name": "network-vif-unplugged", "status": "completed", "tag": "ef59344c-d6c6-4288-bbb7-4716d65ba16e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:03.779545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1ca39b6a-97ff-487f-b6e4-75edaafeb8b9 req-d0a324e7-7c53-4140-be93-74b41d88f29c service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:03.780991 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1ca39b6a-97ff-487f-b6e4-75edaafeb8b9 req-d0a324e7-7c53-4140-be93-74b41d88f29c service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:03.781801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1ca39b6a-97ff-487f-b6e4-75edaafeb8b9 req-d0a324e7-7c53-4140-be93-74b41d88f29c service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:03.783613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-3e5eac20-0b29-4d60-b073-0f63d245146c req-ded66451-39f0-4fe7-9c88-fcf1926b79c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e574f9ab-e5b1-4762-bf2e-211d8fd993fa", "name": "network-vif-deleted", "tag": "18d7ddf0-d73b-4db0-8dca-21e9889e695f"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:03.800594 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.compute.server_external_events [req-1ca39b6a-97ff-487f-b6e4-75edaafeb8b9 req-d0a324e7-7c53-4140-be93-74b41d88f29c service nova] Unable to find a host for instance fdc7093e-ac27-4690-84d8-033d4912129e. Dropping event network-vif-unplugged {{(pid=120739) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 16:24:03.802282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-1ca39b6a-97ff-487f-b6e4-75edaafeb8b9 req-d0a324e7-7c53-4140-be93-74b41d88f29c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043551 Sep 06 16:24:03.804262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 480/930] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 16:24:03.805043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3e5eac20-0b29-4d60-b073-0f63d245146c req-ded66451-39f0-4fe7-9c88-fcf1926b79c4 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:03.805532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3e5eac20-0b29-4d60-b073-0f63d245146c req-ded66451-39f0-4fe7-9c88-fcf1926b79c4 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:03.805966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3e5eac20-0b29-4d60-b073-0f63d245146c req-ded66451-39f0-4fe7-9c88-fcf1926b79c4 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:03.821263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-3e5eac20-0b29-4d60-b073-0f63d245146c req-ded66451-39f0-4fe7-9c88-fcf1926b79c4 service nova] Creating event network-vif-deleted:18d7ddf0-d73b-4db0-8dca-21e9889e695f for instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa on hv-cinder-85220 Sep 06 16:24:03.829234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-3e5eac20-0b29-4d60-b073-0f63d245146c req-ded66451-39f0-4fe7-9c88-fcf1926b79c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053012 Sep 06 16:24:03.829845 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 451/931] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:24:04.506567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:04.507218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:04.514515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:04.515047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:04.515473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:04.516160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:04.516606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:04.517037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:04.550981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:04.551362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:04.551793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:04.552227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lazy-loading 'fault' on Instance uuid e574f9ab-e5b1-4762-bf2e-211d8fd993fa {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:24:04.604186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eda6839efaab4317a0eda1f47f1656a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1e05e9e4a940e78a43d397f0c0db16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:04.611395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-29b65783-5698-42eb-9180-173237c2fbcd tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 200 len: 1312 microversion: 2.1 time: 0.108656 Sep 06 16:24:04.611956 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 481/932] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:04 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:04.691157 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:04.691886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:04.699519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:04.700004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:04.700444 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:04.701139 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:04.701594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:04.702020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:04.908555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:04.916746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a98de602-d1aa-445a-80d8-85189ecc3af6 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.229779 Sep 06 16:24:04.917985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 452/933] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:04 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:05.635511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:05.636086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] [instance: e574f9ab-e5b1-4762-bf2e-211d8fd993fa] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:05.643302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:05.643784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:05.644218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:05.644914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:05.645363 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:05.645782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:05.661208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] HTTP exception thrown: Instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa could not be found. Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Request method failure captured: Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa HTTP/1.1 Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Hdgju97tQEPcRdHdLythvqGQSY2DsXgDVo-YwRbq86iiMwtEfs6p6WVIpgQQ8HXRst0XJLhtYylMq_O5tsHQdLVoaQvn0nvFuENdKxQ84q_KS_BHm6PtliV88UEis-RxvqrCTOwCt9tSKsl1IrIL-zmidECL4F0XaB00VFksv30dQ Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:24:05.662903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d1e05e9e4a940e78a43d397f0c0db16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 6d1e05e9e4a940e78a43d397f0c0db16 Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1201899900 Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: eda6839efaab4317a0eda1f47f1656a2 Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1201899900-project Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa could not be found. Sep 06 16:24:05.665389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'e574f9ab-e5b1-4762-bf2e-211d8fd993fa'} Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa could not be found. Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:24:05.666781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa could not be found. Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa could not be found. Sep 06 16:24:05.669391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:24:05.672006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] Returning 404 to user: Instance e574f9ab-e5b1-4762-bf2e-211d8fd993fa could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:24:05.672006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9fa1d8d1-9adc-4acb-9784-3ff9dc9009c9 tempest-ServerRescueNegativeTestJSON-1201899900 tempest-ServerRescueNegativeTestJSON-1201899900-project] 10.222.0.26 "GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa" status: 404 len: 111 microversion: 2.1 time: 0.032988 Sep 06 16:24:05.672006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 482/934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:05 2022] GET /compute/v2.1/servers/e574f9ab-e5b1-4762-bf2e-211d8fd993fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:24:05.940654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:05.941254 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:05.948178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:05.949233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:05.949752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:05.950452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:05.950927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:05.951348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:06.094617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:06.102938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e6d73d0b-d7f2-4790-91be-3efdb18d3f60 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.166248 Sep 06 16:24:06.103502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 453/935] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:05 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:07.126873 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:07.127853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:07.134228 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:07.134727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:07.135165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:07.135852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:07.137109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:07.137109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:07.378207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:07.388010 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8b44ba89-1fc0-4e27-83c3-eadafd74d8e5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.264759 Sep 06 16:24:07.388595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 483/936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:07 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:08.419553 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:08.420362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:08.427128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:08.427808 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:08.428496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:08.429295 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:08.429963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:08.430471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:08.655604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:08.665498 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3cfd3630-7401-4edc-9c68-b35967347634 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.251764 Sep 06 16:24:08.666340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 454/937] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:08 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:09.690546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:09.691478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:09.702235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:09.702761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:09.703614 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:09.704294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:09.704749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:09.705172 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:09.846578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:09.854352 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-71a3b723-c952-4dc6-8a63-23cf19e76e50 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.167835 Sep 06 16:24:09.855685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 484/938] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:09 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:10.878615 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:10.879398 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:10.886362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:10.886964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:10.887447 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:10.888159 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:10.888620 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:10.889045 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:11.106237 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:11.115394 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e54b541d-d422-4b56-a448-1eb641e14c72 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.240768 Sep 06 16:24:11.116121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 455/939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:10 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:12.144958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:12.146761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:12.154396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:12.157863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:12.158480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:12.163567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:12.164039 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:12.164801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:12.328658 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:12.336859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f1a28b35-2ac8-4b2a-ad7a-c0ee77c6e357 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.196943 Sep 06 16:24:12.337460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 485/940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:12 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:13.361721 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:13.363113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:13.369897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:13.370503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:13.372188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:13.373049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:13.373768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:13.374291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:13.610086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:13.618312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-265d25c7-7d20-4870-b534-6e8a7d53c5b3 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.260362 Sep 06 16:24:13.619540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 456/941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:13 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:14.642703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:14.643724 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:14.654453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:14.655109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:14.655745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:14.656429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:14.657110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:14.657250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:14.807502 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:14.817168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-268f7886-96a6-4d91-8ca0-e90e3a3f8bca tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.178300 Sep 06 16:24:14.817878 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 486/942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:14 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:15.013745 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e41b18b6-a6e7-4be7-9d08-7d89dfa7f1da tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'create', calling method: .version_select at 0x7f21bb852af0>, body: {"keypair": {"name": "tempest-keypair-425751295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxOjf2xYEHwaCvMC2KGYD5EmN4EIrM2jZt9bnPOyleeamMjEixXbuQ0OLk27Gma9AFy0lU6/buAl7vWaKepZ2opBVCNDwuEkpGEqs8pcxegef1tpr9TFz7Nyw28DZcDnQ=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:15.031155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e41b18b6-a6e7-4be7-9d08-7d89dfa7f1da tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for project 0679691b1c674dc4968638b8a93d4858. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:15.035463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-e41b18b6-a6e7-4be7-9d08-7d89dfa7f1da tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for user 66df80c268094c48abf73f1323aa23de and project 0679691b1c674dc4968638b8a93d4858. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:15.062034 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e41b18b6-a6e7-4be7-9d08-7d89dfa7f1da tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.191932 Sep 06 16:24:15.068909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 457/943] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Sep 6 16:24:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 16:24:15.840685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:15.841281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:15.848388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:15.848894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:15.849339 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:15.850056 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:15.850513 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:15.850965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:15.992759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:16.001484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5969172-608b-4594-8596-c9abe0d789f9 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.164732 Sep 06 16:24:16.002864 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 487/944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:15 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:16.505070 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-292390439", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fc1df11-bf93-4c37-9640-5ebe913b0cfa"}], "security_groups": [{"name": "tempest-securitygroup--1687136422"}], "key_name": "tempest-keypair-425751295", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:16.515295 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:16.552735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-03e2be99-73a3-4d68-a070-ff6f312de6f9 req-e354e961-96c2-4742-8f0b-82ab0e140caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc7093e-ac27-4690-84d8-033d4912129e", "name": "network-vif-plugged", "status": "completed", "tag": "ef59344c-d6c6-4288-bbb7-4716d65ba16e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:16.558583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:16.567239 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-03e2be99-73a3-4d68-a070-ff6f312de6f9 req-e354e961-96c2-4742-8f0b-82ab0e140caf service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:16.568856 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-03e2be99-73a3-4d68-a070-ff6f312de6f9 req-e354e961-96c2-4742-8f0b-82ab0e140caf service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:16.569505 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-03e2be99-73a3-4d68-a070-ff6f312de6f9 req-e354e961-96c2-4742-8f0b-82ab0e140caf service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:16.584731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-03e2be99-73a3-4d68-a070-ff6f312de6f9 req-e354e961-96c2-4742-8f0b-82ab0e140caf service nova] Creating event network-vif-plugged:ef59344c-d6c6-4288-bbb7-4716d65ba16e for instance fdc7093e-ac27-4690-84d8-033d4912129e on hv-cinder-85220 Sep 06 16:24:16.595327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-03e2be99-73a3-4d68-a070-ff6f312de6f9 req-e354e961-96c2-4742-8f0b-82ab0e140caf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044583 Sep 06 16:24:16.595973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 488/945] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:24:16.637145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] validate_networks() for [('9fc1df11-bf93-4c37-9640-5ebe913b0cfa', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:24:17.028712 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:17.029475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:17.036525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:17.037018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:17.037511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:17.038218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:17.038892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:17.039320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:17.045062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:17.117510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:24:17.117943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:24:17.118419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:24:17.118857 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:24:17.119454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:24:17.130218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:17.130805 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:17.131438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:17.132345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:17.132953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:17.133553 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:17.152222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for project 0679691b1c674dc4968638b8a93d4858. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:17.156685 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for user 66df80c268094c48abf73f1323aa23de and project 0679691b1c674dc4968638b8a93d4858. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:17.170076 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:24:17.172466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:24:17.196459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:17.205699 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-728c7e5f-046a-4987-a5f5-5b8079e2e823 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.181393 Sep 06 16:24:17.206580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 489/946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:17 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:17.240748 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-88f7782b-36dd-4e26-a45b-c1d06dca6292 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.739999 Sep 06 16:24:17.241671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 458/947] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Sep 6 16:24:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 16:24:17.252813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f95f84e0-bf4a-4b02-8898-5b94697828fd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:17.253632 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f95f84e0-bf4a-4b02-8898-5b94697828fd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:17.330385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f95f84e0-bf4a-4b02-8898-5b94697828fd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:17.340234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f95f84e0-bf4a-4b02-8898-5b94697828fd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:17.341780 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f95f84e0-bf4a-4b02-8898-5b94697828fd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:17.342977 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f95f84e0-bf4a-4b02-8898-5b94697828fd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1280 microversion: 2.20 time: 0.094003 Sep 06 16:24:17.343545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 490/948] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:17 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:18.233366 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:18.234098 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:18.240271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:18.240766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:18.241204 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:18.241917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:18.242371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:18.242831 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:18.369558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:18.370813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:18.378399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:18.379359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:18.379965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:18.380841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:18.381532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:18.382122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:18.468945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:18.480250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:18.482269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:18.483744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-651e492e-8331-4390-8452-24cf56f63427 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1332 microversion: 2.20 time: 0.119013 Sep 06 16:24:18.498706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 491/949] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:18 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:18.801027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:18.809891 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5ef3b7d3-a03b-4d68-9f5d-950f1ad6b78e tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1574 microversion: 2.1 time: 0.582166 Sep 06 16:24:18.810592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 459/950] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:18 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1574 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:19.509427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:19.510186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:19.518179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:19.519026 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:19.519539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:19.520359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:19.520814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:19.521421 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:19.607971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:19.617427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:19.619022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:19.620164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-34b29598-39d0-4203-9645-8139066c5d5b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1350 microversion: 2.20 time: 0.114691 Sep 06 16:24:19.622115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 492/951] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:19 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:19.833806 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:19.834471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:19.842056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:19.842547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:19.843026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:19.843746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:19.844207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:19.844633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:20.065486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:20.074492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-34529936-737b-4697-9768-51822b20d1e4 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1561 microversion: 2.1 time: 0.244640 Sep 06 16:24:20.075104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 460/952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:19 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:20.648624 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:20.650591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:20.658789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:20.659147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:20.659659 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:20.660784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:20.661463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:20.661988 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:20.801529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:20.809974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:20.811469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:20.812625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fa99c3da-de57-4eff-81ad-15a0dc7ee35d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1406 microversion: 2.20 time: 0.168168 Sep 06 16:24:20.826399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 493/953] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:20 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:21.236883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-72fbf455-d504-4695-b146-37fb14f28984 req-93836878-d64f-4785-a4f6-ab55789f0f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2891ad36-504d-4c32-a783-6d93e3a4b43b", "tag": "a96c2f08-a914-47c2-b41e-30eb8c3f0faa"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:21.249557 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-72fbf455-d504-4695-b146-37fb14f28984 req-93836878-d64f-4785-a4f6-ab55789f0f94 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:21.250050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-72fbf455-d504-4695-b146-37fb14f28984 req-93836878-d64f-4785-a4f6-ab55789f0f94 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:21.250263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-72fbf455-d504-4695-b146-37fb14f28984 req-93836878-d64f-4785-a4f6-ab55789f0f94 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:21.263253 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-72fbf455-d504-4695-b146-37fb14f28984 req-93836878-d64f-4785-a4f6-ab55789f0f94 service nova] Creating event network-changed:a96c2f08-a914-47c2-b41e-30eb8c3f0faa for instance 2891ad36-504d-4c32-a783-6d93e3a4b43b on hv-cinder-85220 Sep 06 16:24:21.268777 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-72fbf455-d504-4695-b146-37fb14f28984 req-93836878-d64f-4785-a4f6-ab55789f0f94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035588 Sep 06 16:24:21.269532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 461/954] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:21.839250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:21.839847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:21.847375 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:21.847863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:21.848294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:21.848993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:21.849515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:21.850146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:22.051777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:22.061113 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:22.062582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:22.063710 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c88d51ab-de5d-4b8c-8c40-c5a2c61fec70 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1406 microversion: 2.20 time: 0.228501 Sep 06 16:24:22.064280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 494/955] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:21 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:23.090717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:23.091543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:23.099184 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:23.099668 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:23.100105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:23.100809 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:23.101263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:23.101687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:23.314410 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:23.327742 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:23.329382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:23.330773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1b071631-7bef-4032-bbdf-3cacb68d9955 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1406 microversion: 2.20 time: 0.244642 Sep 06 16:24:23.331353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 462/956] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:23 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:24.358294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:24.360055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:24.366790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:24.367293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:24.367737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:24.368458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:24.368916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:24.369347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:24.530313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:24.540548 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:24.543627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:24.544298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-151962e0-81b5-4536-925e-63f3d5f3a774 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1406 microversion: 2.20 time: 0.190421 Sep 06 16:24:24.544669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 495/957] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:24 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:25.572911 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:25.575163 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:25.583368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:25.583860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:25.593389 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:25.594482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:25.595012 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:25.595450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:25.830409 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:25.844289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:25.845765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:25.847279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5a210bec-fc58-4778-a223-b6f27a03c5d8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1406 microversion: 2.20 time: 0.278712 Sep 06 16:24:25.848168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 463/958] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:25 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:26.615364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-bf450fdd-a978-470c-87d3-82fc8c44505a req-2956305e-9d5f-41f9-a0aa-02abafc86463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2891ad36-504d-4c32-a783-6d93e3a4b43b", "name": "network-vif-plugged", "status": "completed", "tag": "a96c2f08-a914-47c2-b41e-30eb8c3f0faa"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:26.626879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bf450fdd-a978-470c-87d3-82fc8c44505a req-2956305e-9d5f-41f9-a0aa-02abafc86463 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:26.627158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bf450fdd-a978-470c-87d3-82fc8c44505a req-2956305e-9d5f-41f9-a0aa-02abafc86463 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:26.627593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bf450fdd-a978-470c-87d3-82fc8c44505a req-2956305e-9d5f-41f9-a0aa-02abafc86463 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:26.640519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-bf450fdd-a978-470c-87d3-82fc8c44505a req-2956305e-9d5f-41f9-a0aa-02abafc86463 service nova] Creating event network-vif-plugged:a96c2f08-a914-47c2-b41e-30eb8c3f0faa for instance 2891ad36-504d-4c32-a783-6d93e3a4b43b on hv-cinder-85220 Sep 06 16:24:26.646431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-bf450fdd-a978-470c-87d3-82fc8c44505a req-2956305e-9d5f-41f9-a0aa-02abafc86463 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035561 Sep 06 16:24:26.647364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 496/959] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:26.874992 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:26.875758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:26.881790 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:26.882359 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:26.882916 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:26.883635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:26.884084 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:26.884730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:27.041778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:27.050103 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:27.051617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:27.052725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a465384f-35e3-496b-8f36-fcff6b921b00 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1406 microversion: 2.20 time: 0.182262 Sep 06 16:24:27.053279 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 464/960] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:26 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:28.075840 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:28.081272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:28.081852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:28.088625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:28.089110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:28.089540 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:28.090300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:28.090690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:28.091099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:28.256673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:28.271679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:28.274312 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:28.276648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-53d27d78-d15e-43f0-b0e5-aa6c05386f15 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1406 microversion: 2.20 time: 0.201653 Sep 06 16:24:28.277630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 497/961] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:28 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:24:29.307006 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:29.307629 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:29.309715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:29.310389 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=10 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:29.317213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:29.317713 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:29.318214 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:29.319391 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:29.319950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:29.320288 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:29.459815 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:29.468542 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:29.470601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:29.471802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f13a1c2d-a152-41c6-b442-bc224ae179f2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1597 microversion: 2.20 time: 0.170920 Sep 06 16:24:29.472356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 465/962] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:24:29 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:24:29.496879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:29.497409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:29.504541 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:29.505021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:29.505456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:29.506175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:29.506627 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:29.507075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:29.599778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bc7a0329-8702-4997-b778-e2c7a5dc60ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106669 Sep 06 16:24:29.600499 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 498/963] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Sep 6 16:24:29 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:24:30.627840 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-5d337f23-f771-494f-9d5e-6bdfa4d288c4 req-71d7c02a-26e2-463d-8a8b-f9c0181b84ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2891ad36-504d-4c32-a783-6d93e3a4b43b", "tag": "a96c2f08-a914-47c2-b41e-30eb8c3f0faa"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:30.644827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5d337f23-f771-494f-9d5e-6bdfa4d288c4 req-71d7c02a-26e2-463d-8a8b-f9c0181b84ef service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:30.645313 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5d337f23-f771-494f-9d5e-6bdfa4d288c4 req-71d7c02a-26e2-463d-8a8b-f9c0181b84ef service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:30.645751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5d337f23-f771-494f-9d5e-6bdfa4d288c4 req-71d7c02a-26e2-463d-8a8b-f9c0181b84ef service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:30.658905 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-5d337f23-f771-494f-9d5e-6bdfa4d288c4 req-71d7c02a-26e2-463d-8a8b-f9c0181b84ef service nova] Creating event network-changed:a96c2f08-a914-47c2-b41e-30eb8c3f0faa for instance 2891ad36-504d-4c32-a783-6d93e3a4b43b on hv-cinder-85220 Sep 06 16:24:30.665750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-5d337f23-f771-494f-9d5e-6bdfa4d288c4 req-71d7c02a-26e2-463d-8a8b-f9c0181b84ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046966 Sep 06 16:24:30.666543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 466/964] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:44.265818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=23 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:44.266567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=46 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:44.271735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:44.274300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:44.282024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.283403 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.283853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.284605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.285062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.285490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.316178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-36a4150a-0c59-4a32-8541-1e0f00947c82 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051995 Sep 06 16:24:44.316755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 499/965] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:24:44 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:24:44.388693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:44.389585 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:24:44.394935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:44.395541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:44.403556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.404137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.404541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.405260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.405714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.406140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.436983 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:24:44.533799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ccb71cc5-4116-4300-8a46-acd29c41245f tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 204 len: 0 microversion: 2.1 time: 0.146915 Sep 06 16:24:44.534394 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 467/966] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:24:44 2022] DELETE /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:24:44.542651 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:44.543307 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:44.550161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.550653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.551125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.551828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:44.552283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:44.552713 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:44.688226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:44.696835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bc33e54e-1a29-4e4d-a5cf-808120979ef7 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1671 microversion: 2.1 time: 0.158006 Sep 06 16:24:44.697410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 500/967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:44 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:45.723973 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:45.724772 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:45.731172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:45.731658 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:45.732094 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:45.732807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:45.733257 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:45.733681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:45.932172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:45.941646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-119a8be7-8a0d-428e-8526-a6f8a658619a tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1671 microversion: 2.1 time: 0.223344 Sep 06 16:24:45.942308 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 468/968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:45 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:46.968349 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:46.968985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:46.975970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:46.976457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:46.976887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:46.977581 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:46.978027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:46.978449 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:47.052718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:47.062289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b99eb8df-a353-4099-a4e4-264b9e71740c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1605 microversion: 2.1 time: 0.097971 Sep 06 16:24:47.062933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 501/969] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:46 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:47.348264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-30b5d0c9-ff0e-4100-a3e7-c21bb1817e50 req-90eff434-78d6-4317-b5f9-fb20eff0e518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d89aa26-192e-4016-93ea-772996bb9e49", "name": "network-vif-deleted", "tag": "d1ec24f6-7663-4504-af80-9955a9372f97"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:47.362985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-30b5d0c9-ff0e-4100-a3e7-c21bb1817e50 req-90eff434-78d6-4317-b5f9-fb20eff0e518 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:47.362985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-30b5d0c9-ff0e-4100-a3e7-c21bb1817e50 req-90eff434-78d6-4317-b5f9-fb20eff0e518 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:47.362985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-30b5d0c9-ff0e-4100-a3e7-c21bb1817e50 req-90eff434-78d6-4317-b5f9-fb20eff0e518 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:47.373347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-30b5d0c9-ff0e-4100-a3e7-c21bb1817e50 req-90eff434-78d6-4317-b5f9-fb20eff0e518 service nova] Creating event network-vif-deleted:d1ec24f6-7663-4504-af80-9955a9372f97 for instance 1d89aa26-192e-4016-93ea-772996bb9e49 on hv-cinder-85220 Sep 06 16:24:47.380223 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-30b5d0c9-ff0e-4100-a3e7-c21bb1817e50 req-90eff434-78d6-4317-b5f9-fb20eff0e518 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Sep 06 16:24:47.380851 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 469/970] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:48.089914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:48.090827 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:48.101357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:48.101908 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:48.102906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:48.103830 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:48.104384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:48.104850 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:48.175261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:48.176111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:48.179233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:48.179737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 1d89aa26-192e-4016-93ea-772996bb9e49 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:24:48.234856 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:48.243322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-348b8dd7-1b58-4006-b0ff-05c2e7e76551 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 200 len: 1327 microversion: 2.1 time: 0.158698 Sep 06 16:24:48.244001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 502/971] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:48 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:49.269709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:49.270438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:49.276903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:49.277390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:49.277829 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:49.278560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:49.279047 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:49.279477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:49.293949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] HTTP exception thrown: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Request method failure captured: Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 HTTP/1.1 Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Jel1NYp-w3Ncno-9EGtyIn9Y_i4sRz8CvZhUAo5uX1u21ZYELiVXea7FBVyTSwIvxIvqMalIT6XDeMkHLxcwFiDq53w1Kl7d7XkvZ5McoEEq3mPqjn_4J2WQUBAa9eAXycFc85rlXSX4ZQ_SwALghTP5wvkK2jBgjmOK__uX80zWY Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:24:49.295737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 72cc5f5b1b6b4fb28d57c7ff7931fdff Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:24:49.297433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '1d89aa26-192e-4016-93ea-772996bb9e49'} Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:24:49.300218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:24:49.301788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:24:49.303215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Returning 404 to user: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:24:49.303215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-20d1359a-a4de-4205-9a41-07fc22066368 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 404 len: 111 microversion: 2.1 time: 0.032584 Sep 06 16:24:49.303215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 470/972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:49 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:24:49.307200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5e9ad6e-e05b-4271-8bf4-c1255f3f62fd tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '.version_select at 0x7f21b3ee4670>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:49.328717 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5e9ad6e-e05b-4271-8bf4-c1255f3f62fd tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451229691" status: 202 len: 0 microversion: 2.1 time: 0.025227 Sep 06 16:24:49.329302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 503/973] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Sep 6 16:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451229691 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:24:49.977262 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ac6eef86-e4c2-405d-9618-716130e43579 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'create', calling method: .version_select at 0x7f21b8187d30>, body: {"keypair": {"name": "tempest-keypair-629378530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWP+4ENXY/Nv7q/uPDhLHl9XtKPgnz0YEkTOwgYbSkG14bDERIal8F3tSveD8j8qyGWgWUA2XK6NoOOvhpyvt+aYs5g1xzxW3SP25Qh9TlQlY1KL1tyIIn7bUUpDWSLbQ=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:49.993478 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-ac6eef86-e4c2-405d-9618-716130e43579 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for project b52ac4a27fe84303970a9f7e104c5298. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:49.997822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-ac6eef86-e4c2-405d-9618-716130e43579 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for user 72cc5f5b1b6b4fb28d57c7ff7931fdff and project b52ac4a27fe84303970a9f7e104c5298. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:50.021048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ac6eef86-e4c2-405d-9618-716130e43579 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047664 Sep 06 16:24:50.021667 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 471/974] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:24:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:51.436048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-94272857", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "87b59ecc-5db9-4aa4-8f2c-2efc340f1ba7"}], "security_groups": [{"name": "tempest-securitygroup--871267869"}], "key_name": "tempest-keypair-629378530", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:51.544208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] validate_networks() for [('87b59ecc-5db9-4aa4-8f2c-2efc340f1ba7', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:24:51.978566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:24:51.979022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:24:51.979494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:24:51.979911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:24:51.980318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:24:51.989813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.990284 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.990738 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:51.991462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:51.991915 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:51.992334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:52.010377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for project b52ac4a27fe84303970a9f7e104c5298. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:24:52.014301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Getting quotas for user 72cc5f5b1b6b4fb28d57c7ff7931fdff and project b52ac4a27fe84303970a9f7e104c5298. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:24:52.025828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:24:52.028147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:24:52.077981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bbbc5d3d-74cb-4610-8902-464d759655a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.646608 Sep 06 16:24:52.078639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 504/975] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:24:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:24:52.091823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0213bb27-4f2d-4b9a-99ee-07be9b461a39 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:52.093090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0213bb27-4f2d-4b9a-99ee-07be9b461a39 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:52.155452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0213bb27-4f2d-4b9a-99ee-07be9b461a39 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:52.163028 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0213bb27-4f2d-4b9a-99ee-07be9b461a39 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1235 microversion: 2.1 time: 0.075519 Sep 06 16:24:52.163596 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 472/976] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:52 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:53.187486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:53.188130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:53.196593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.197184 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.197805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.198822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:53.199542 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:53.200053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:53.269920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:53.277624 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a4558d82-79d8-49f8-895e-a38822ae9746 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1287 microversion: 2.1 time: 0.095075 Sep 06 16:24:53.278196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 505/977] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:53 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:54.301791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:54.302427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:54.309980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:54.310575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:54.311075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:54.311798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:54.312254 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:54.312691 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:54.538384 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:54.546280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cb2bc692-b6f8-4307-8271-9d6df55cab6e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.248581 Sep 06 16:24:54.546888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 473/978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:54 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:55.067442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-cd58a2f7-0973-4312-89d4-af517ac82994 req-ba11280d-d477-4b9e-859c-2522f20ceef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cb0205-745c-4ec5-8e7f-be4abd758c3d", "tag": "e6418311-8073-44d1-86e5-dc002799f972"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:55.077721 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cd58a2f7-0973-4312-89d4-af517ac82994 req-ba11280d-d477-4b9e-859c-2522f20ceef0 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.078288 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cd58a2f7-0973-4312-89d4-af517ac82994 req-ba11280d-d477-4b9e-859c-2522f20ceef0 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.078831 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cd58a2f7-0973-4312-89d4-af517ac82994 req-ba11280d-d477-4b9e-859c-2522f20ceef0 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.091320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-cd58a2f7-0973-4312-89d4-af517ac82994 req-ba11280d-d477-4b9e-859c-2522f20ceef0 service nova] Creating event network-changed:e6418311-8073-44d1-86e5-dc002799f972 for instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d on hv-cinder-85220 Sep 06 16:24:55.096782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-cd58a2f7-0973-4312-89d4-af517ac82994 req-ba11280d-d477-4b9e-859c-2522f20ceef0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032730 Sep 06 16:24:55.097390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 506/979] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:55.570777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:55.571744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:55.579413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.580018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.581099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.582031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.582694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.583303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.606589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:55.607729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:55.614395 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.614920 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.615371 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.616078 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:55.616734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:55.617165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:55.646939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-24a46e3f-fc20-48ab-9d50-83eae2738b02 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/ips" status: 200 len: 150 microversion: 2.1 time: 0.194278 Sep 06 16:24:55.648051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 474/980] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:24:55 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/ips => generated 150 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:24:55.722414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:55.730068 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7c5e42c1-0a81-4a60-877f-79990da38500 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.163754 Sep 06 16:24:55.730637 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 507/981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:55 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:56.753780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:56.754387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:56.760894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:56.761385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:56.761827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:56.762525 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:56.763017 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:56.763453 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:56.894313 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:56.902067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0bb0dc36-9c9a-47e8-8034-afe8d73dbad4 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.152758 Sep 06 16:24:56.902629 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 475/982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:56 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:57.929265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:57.929796 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:57.943438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:57.943928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:57.944367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:57.945072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:57.945525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:57.945950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:58.048111 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d29c8dca-08de-472a-ac5e-612bf8043c63"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:24:58.050789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:58.057549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:58.058036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:58.058475 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:58.059219 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:58.059671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:58.060131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:58.080015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:58.088317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-262e44a0-660f-4844-808d-6d632d7f70f0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.162961 Sep 06 16:24:58.088894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 508/983] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:57 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:24:59.112879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:24:59.113575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:24:59.120163 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:59.120643 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:59.121073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:59.121775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:24:59.122222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:24:59.122640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:24:59.263308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:24:59.271920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-17991372-6de7-42c7-8abc-072665b870b8 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.163496 Sep 06 16:24:59.272491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 509/984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:24:59 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:24:59.510065 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-25ba2557-04c2-4dfc-b525-fe4101e127d9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.465735 Sep 06 16:24:59.510968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 476/985] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:24:58 2022] POST /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments => generated 194 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:25:00.295630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:00.296249 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:00.308217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:00.308809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:00.309263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:00.309976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:00.310437 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:00.310891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:00.444446 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:00.452279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1b727085-86f8-4b3e-bc79-f9031bcf4497 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.160574 Sep 06 16:25:00.452851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 510/986] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:00 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:00.837878 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-ae5e95ac-84c9-45a6-84b5-9bf84801d5fc req-f2b58890-eb51-42d8-a0cc-e70e67f5e423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cb0205-745c-4ec5-8e7f-be4abd758c3d", "name": "network-vif-plugged", "status": "completed", "tag": "e6418311-8073-44d1-86e5-dc002799f972"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:00.850774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ae5e95ac-84c9-45a6-84b5-9bf84801d5fc req-f2b58890-eb51-42d8-a0cc-e70e67f5e423 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:00.851270 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ae5e95ac-84c9-45a6-84b5-9bf84801d5fc req-f2b58890-eb51-42d8-a0cc-e70e67f5e423 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:00.851707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ae5e95ac-84c9-45a6-84b5-9bf84801d5fc req-f2b58890-eb51-42d8-a0cc-e70e67f5e423 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:00.863841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-ae5e95ac-84c9-45a6-84b5-9bf84801d5fc req-f2b58890-eb51-42d8-a0cc-e70e67f5e423 service nova] Creating event network-vif-plugged:e6418311-8073-44d1-86e5-dc002799f972 for instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d on hv-cinder-85220 Sep 06 16:25:00.869141 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-ae5e95ac-84c9-45a6-84b5-9bf84801d5fc req-f2b58890-eb51-42d8-a0cc-e70e67f5e423 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035942 Sep 06 16:25:00.869798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 477/987] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:01.475901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:01.476451 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:01.482824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:01.483310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:01.483749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:01.484457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:01.484898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:01.485327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:01.620254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:01.629196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dba10029-a9b7-4640-b541-488f529f7895 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.158115 Sep 06 16:25:01.629774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 511/988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:01 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:02.653772 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:02.658245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:02.659122 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:02.666632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:02.667146 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:02.667586 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:02.668282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:02.668738 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:02.669169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:02.806408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:02.814172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6844f7cf-475e-4cfc-ae91-637727676354 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1360 microversion: 2.1 time: 0.161904 Sep 06 16:25:02.816012 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 478/989] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:02 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:03.839192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:03.839800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:03.842410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:03.843265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:03.851910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:03.852401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:03.852840 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:03.853546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:03.853997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:03.854425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:03.995423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:04.004734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1538aaca-a749-4ec4-ae2e-707aa7e9b72d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1546 microversion: 2.1 time: 0.169240 Sep 06 16:25:04.005332 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 512/990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:03 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:04.039360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:04.039934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:04.046443 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:04.046965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:04.047400 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:04.048110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:04.048557 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:04.049509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:04.132399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-38d11fc6-2238-4618-9142-044749a175cf tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096997 Sep 06 16:25:04.133013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 479/991] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:25:04 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:05.086891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-82d093d3-69ff-4e50-a105-a53cdf299f80 req-58e5ec23-1ab8-48f0-a68b-1e433a2bc13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cb0205-745c-4ec5-8e7f-be4abd758c3d", "tag": "e6418311-8073-44d1-86e5-dc002799f972"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:05.097401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82d093d3-69ff-4e50-a105-a53cdf299f80 req-58e5ec23-1ab8-48f0-a68b-1e433a2bc13d service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:05.097952 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82d093d3-69ff-4e50-a105-a53cdf299f80 req-58e5ec23-1ab8-48f0-a68b-1e433a2bc13d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:05.098444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82d093d3-69ff-4e50-a105-a53cdf299f80 req-58e5ec23-1ab8-48f0-a68b-1e433a2bc13d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:05.109577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-82d093d3-69ff-4e50-a105-a53cdf299f80 req-58e5ec23-1ab8-48f0-a68b-1e433a2bc13d service nova] Creating event network-changed:e6418311-8073-44d1-86e5-dc002799f972 for instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d on hv-cinder-85220 Sep 06 16:25:05.114858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-82d093d3-69ff-4e50-a105-a53cdf299f80 req-58e5ec23-1ab8-48f0-a68b-1e433a2bc13d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 Sep 06 16:25:05.115457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 513/992] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:07.102059 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d29c8dca-08de-472a-ac5e-612bf8043c63"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:07.104508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:07.110485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:07.111025 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:07.111641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:07.112421 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:07.112880 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:07.113314 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:07.192570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Invalid volume: volume d29c8dca-08de-472a-ac5e-612bf8043c63 is already attached to instances: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments HTTP/1.1 Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 74 Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:25:07.194342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {"volumeAttachment": {"volumeId": "d29c8dca-08de-472a-ac5e-612bf8043c63"}} Sep 06 16:25:07.196024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Invalid volume: volume d29c8dca-08de-472a-ac5e-612bf8043c63 is already attached to instances: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'server_id': '3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35', 'body': {'volumeAttachment': {'volumeId': 'd29c8dca-08de-472a-ac5e-612bf8043c63'}}} Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d29c8dca-08de-472a-ac5e-612bf8043c63 is already attached to instances: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:07.196936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d29c8dca-08de-472a-ac5e-612bf8043c63 is already attached to instances: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:07.198350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d29c8dca-08de-472a-ac5e-612bf8043c63 is already attached to instances: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 400 to user: Invalid volume: volume d29c8dca-08de-472a-ac5e-612bf8043c63 is already attached to instances: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-efc62e36-1a14-41d0-bfc8-3cd0b7665fb5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098511 Sep 06 16:25:07.200140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 480/993] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:25:07 2022] POST /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:25:07.263705 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:07.264229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:07.271119 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:07.271598 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:07.272068 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:07.272795 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:07.273248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:07.273676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:07.355887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lazy-loading 'services' on Instance uuid 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:25:07.425479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a78a223c-7ff4-474f-95fa-6acc8ae597e5 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments/d29c8dca-08de-472a-ac5e-612bf8043c63" status: 202 len: 0 microversion: 2.1 time: 0.166410 Sep 06 16:25:07.426515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 514/994] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:25:07 2022] DELETE /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments/d29c8dca-08de-472a-ac5e-612bf8043c63 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:25:07.435109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:07.437334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:07.445181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:07.445670 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:07.446110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:07.446843 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:07.447300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:07.447762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:07.480654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bfbda814-05ef-4b64-995a-f12eeb6ffccd tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049736 Sep 06 16:25:07.481217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 481/995] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:25:07 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:08.494195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:08.496554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:08.503903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:08.504389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:08.504827 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:08.505521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:08.505969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:08.506388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:08.536789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c79361d2-8a1f-4d13-8a0f-0b165f61f018 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046946 Sep 06 16:25:08.537362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 515/996] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:25:08 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:25:08.605231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:08.605730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:08.612867 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:08.613348 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:08.613788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:08.614477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:08.614963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:08.615384 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:08.642686 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:25:08.717519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e03f5eb0-2d77-45c1-9b23-e6796cf3af8d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 204 len: 0 microversion: 2.1 time: 0.115719 Sep 06 16:25:08.717978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 482/997] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:25:08 2022] DELETE /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:25:08.726618 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:08.727247 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:08.733081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:08.733555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:08.733981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:08.734673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:08.735137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:08.735553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:08.868177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:08.876296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c8a29eb9-1b25-4754-8078-0b6fa06f4e1a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1683 microversion: 2.1 time: 0.153422 Sep 06 16:25:08.876876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 516/998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:08 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:09.901066 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:09.901681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:09.908327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:09.909412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:09.909859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:09.910574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:09.911061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:09.911489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:09.931661 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:10.047996 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:10.056495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-806ddc99-ae8f-49c0-881a-a374cab9e1f3 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1683 microversion: 2.1 time: 0.159789 Sep 06 16:25:10.057044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 483/999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:09 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:11.081024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:11.081909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:11.088182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:11.088671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:11.089119 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:11.089805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:11.090252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:11.090684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:11.114005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:11.250511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:11.259473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0c2dc469-f0c3-4d8f-9652-0017f2f1da3a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1683 microversion: 2.1 time: 0.182932 Sep 06 16:25:11.260041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 517/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:11 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:11.999803 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-f8584530-07b6-4101-bff0-7c7b23fb41d6 req-5f54bf71-c359-4b8d-a83b-0cc7b3cd665a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35", "name": "network-vif-deleted", "tag": "54463ed2-ef2e-4bd8-a2a7-c6042656fa51"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:12.019001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f8584530-07b6-4101-bff0-7c7b23fb41d6 req-5f54bf71-c359-4b8d-a83b-0cc7b3cd665a service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:12.019850 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f8584530-07b6-4101-bff0-7c7b23fb41d6 req-5f54bf71-c359-4b8d-a83b-0cc7b3cd665a service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:12.020490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-f8584530-07b6-4101-bff0-7c7b23fb41d6 req-5f54bf71-c359-4b8d-a83b-0cc7b3cd665a service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:12.034426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-f8584530-07b6-4101-bff0-7c7b23fb41d6 req-5f54bf71-c359-4b8d-a83b-0cc7b3cd665a service nova] Creating event network-vif-deleted:54463ed2-ef2e-4bd8-a2a7-c6042656fa51 for instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 on hv-cinder-85220 Sep 06 16:25:12.041194 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-f8584530-07b6-4101-bff0-7c7b23fb41d6 req-5f54bf71-c359-4b8d-a83b-0cc7b3cd665a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112151 Sep 06 16:25:12.042130 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 484/1001] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:12.284692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:12.285335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:12.291839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:12.292517 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:12.292734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:12.293429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:12.293868 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:12.294292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:12.325882 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:12.326355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:12.326893 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:12.327334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lazy-loading 'fault' on Instance uuid 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:25:12.368139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:12.375849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f2e27191-a817-466b-a1d9-d2ea9b087a83 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 200 len: 1332 microversion: 2.1 time: 0.095769 Sep 06 16:25:12.376435 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 518/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:12 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:13.400071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:13.400664 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:13.406816 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:13.407304 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:13.407733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:13.408924 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:13.409368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:13.409782 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:13.422947 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 HTTP/1.1 Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:25:13.425349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:25:13.426976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35'} Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:25:13.427914 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:25:13.429492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:25:13.431046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:25:13.431046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c6f72419-647e-4aea-ad60-c6a1ab1141b9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 404 len: 111 microversion: 2.1 time: 0.031707 Sep 06 16:25:13.431046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 485/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:13 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:25:13.436342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-432d220a-ff43-4a21-a940-ede19a2deee4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '.version_select at 0x7f21b3e9d820>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:13.456933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-432d220a-ff43-4a21-a940-ede19a2deee4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790383496" status: 202 len: 0 microversion: 2.1 time: 0.024683 Sep 06 16:25:13.457518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 519/1004] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Sep 6 16:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790383496 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:25:14.078035 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5e8c1dfe-6117-4266-a010-bd971f5a57eb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: .version_select at 0x7f21bb90d040>, body: {"keypair": {"name": "tempest-keypair-611491601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS8U8hkLHBLcRrkRnScb4uGKEFAlSBY65jaq6K2TTGck7SVJInvW7xZa0ouqi41iAUU2FsCiWbvhZCMk/r5kk2w/CBN2uhLQ+5p1laIbnfXNkQm0Q8WQd17JkFsUVeHZQ=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:14.093871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-5e8c1dfe-6117-4266-a010-bd971f5a57eb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:25:14.098322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-5e8c1dfe-6117-4266-a010-bd971f5a57eb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:25:14.120283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5e8c1dfe-6117-4266-a010-bd971f5a57eb tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046330 Sep 06 16:25:14.121013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 486/1005] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:25:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:15.632840 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1064009265", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5719a142-0389-455c-a92f-618471f11ba9"}], "security_groups": [{"name": "tempest-securitygroup--1326224898"}], "key_name": "tempest-keypair-611491601", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:15.642273 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:15.737801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] validate_networks() for [('5719a142-0389-455c-a92f-618471f11ba9', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:25:16.110853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:25:16.112186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:25:16.112564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:25:16.112975 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:25:16.113390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:25:16.122520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:16.123034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:16.123472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:16.124268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:16.124754 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:16.125187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:16.142385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:25:16.147101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Getting quotas for user 95ac6a289fb345d3a98871f5e11f9414 and project d306388a489a4b42a98a85e03968dba7. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:25:16.165875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:25:16.169716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:25:16.217027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-45bc1573-9c9a-4702-a325-e351c96c8249 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.588520 Sep 06 16:25:16.217686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 520/1006] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:25:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:25:16.230430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eac139e3-3beb-463e-9300-e1b29293f9d0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:16.231137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eac139e3-3beb-463e-9300-e1b29293f9d0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:16.233082 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:16.291370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eac139e3-3beb-463e-9300-e1b29293f9d0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:16.298534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eac139e3-3beb-463e-9300-e1b29293f9d0 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1241 microversion: 2.1 time: 0.072811 Sep 06 16:25:16.299747 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 487/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:16 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:17.322454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:17.323047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:17.331165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:17.331679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:17.332137 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:17.332837 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:17.333304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:17.333721 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:17.400151 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:17.408196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4491ff1c-7a44-4d5e-b59b-0d041a0cb154 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1293 microversion: 2.1 time: 0.089931 Sep 06 16:25:17.410262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 521/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:17 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:18.431466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:18.432083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:18.438673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:18.439155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:18.439589 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:18.441132 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:18.441663 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:18.442470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:18.673230 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:18.681709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-abb39c5d-1648-4211-9b38-b77ccfb62e7a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.254107 Sep 06 16:25:18.682292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 488/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:18 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:19.043148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-df4c1286-9e97-4e87-89c5-79e24233e107 req-8dba6d03-27a2-46a6-8032-13c14291b3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e96833-c75c-4637-8c58-21bf3949a7f8", "tag": "439668dc-55d5-469b-881b-b0a33d7fae1e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:19.053576 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-df4c1286-9e97-4e87-89c5-79e24233e107 req-8dba6d03-27a2-46a6-8032-13c14291b3c2 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:19.054003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-df4c1286-9e97-4e87-89c5-79e24233e107 req-8dba6d03-27a2-46a6-8032-13c14291b3c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:19.054427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-df4c1286-9e97-4e87-89c5-79e24233e107 req-8dba6d03-27a2-46a6-8032-13c14291b3c2 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:19.067907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-df4c1286-9e97-4e87-89c5-79e24233e107 req-8dba6d03-27a2-46a6-8032-13c14291b3c2 service nova] Creating event network-changed:439668dc-55d5-469b-881b-b0a33d7fae1e for instance 49e96833-c75c-4637-8c58-21bf3949a7f8 on hv-cinder-85220 Sep 06 16:25:19.072687 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-df4c1286-9e97-4e87-89c5-79e24233e107 req-8dba6d03-27a2-46a6-8032-13c14291b3c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Sep 06 16:25:19.073461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 522/1010] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:19.704771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:19.705382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:19.713060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:19.713542 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:19.713976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:19.714691 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:19.715145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:19.715569 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:19.845789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:19.853763 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2cba76c6-cc4f-4707-bd8b-df3c58bd282f tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.152874 Sep 06 16:25:19.854334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 489/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:19 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:25:20.878495 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:20.879385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:20.885427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:20.885911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:20.886350 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:20.887078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:20.887534 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:20.887959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:21.025769 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:21.033406 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c4c3132d-f1c4-4148-ad00-061aae671f30 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.160168 Sep 06 16:25:21.033984 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 523/1012] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:20 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:22.056045 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:22.056694 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:22.063696 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:22.064186 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:22.064627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:22.065325 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:22.065833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:22.066368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:22.201620 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:22.210844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9305f4c1-8ca2-401d-a79f-79f6e6cd7595 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.158545 Sep 06 16:25:22.211403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 490/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:22 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:23.233425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:23.234007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:23.242144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:23.242630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:23.243088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:23.243788 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:23.244229 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:23.244646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:23.371770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:23.380540 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-728a2cd7-78ad-4119-8538-aa08df612d49 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.151074 Sep 06 16:25:23.381108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 524/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:23 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:24.402838 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:24.403396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:24.411790 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:24.412287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:24.412788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:24.413526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:24.413986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:24.414417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:24.555249 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:24.563202 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2841336e-b829-4862-9aa9-1d7c8ff08965 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.164376 Sep 06 16:25:24.564089 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 491/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:24 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:25.586706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:25.587412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:25.593878 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:25.594365 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:25.594842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:25.595548 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:25.596026 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:25.596465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:25.751940 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:25.760090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6b0429b5-b137-4efb-aa68-e9deb072df1e tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.177299 Sep 06 16:25:25.760696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 525/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:25 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:26.784228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:26.785412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:26.787764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:26.793255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:26.793750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:26.794187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:26.794917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:26.795375 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:26.795797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:26.929646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:26.937759 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0856c73d-265e-48f0-acf5-3d5d4c50f18b tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.157497 Sep 06 16:25:26.938574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 492/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:26 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:27.018340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:27.020253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:25:27.078116 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-ddf3f986-6f62-4823-8e5a-08240fac5aa8 req-f78cbe0e-b456-4153-8607-7c6279e39446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e96833-c75c-4637-8c58-21bf3949a7f8", "name": "network-vif-plugged", "status": "completed", "tag": "439668dc-55d5-469b-881b-b0a33d7fae1e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:27.089528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ddf3f986-6f62-4823-8e5a-08240fac5aa8 req-f78cbe0e-b456-4153-8607-7c6279e39446 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:27.090007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ddf3f986-6f62-4823-8e5a-08240fac5aa8 req-f78cbe0e-b456-4153-8607-7c6279e39446 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:27.090439 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ddf3f986-6f62-4823-8e5a-08240fac5aa8 req-f78cbe0e-b456-4153-8607-7c6279e39446 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:27.101744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-ddf3f986-6f62-4823-8e5a-08240fac5aa8 req-f78cbe0e-b456-4153-8607-7c6279e39446 service nova] Creating event network-vif-plugged:439668dc-55d5-469b-881b-b0a33d7fae1e for instance 49e96833-c75c-4637-8c58-21bf3949a7f8 on hv-cinder-85220 Sep 06 16:25:27.107201 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-ddf3f986-6f62-4823-8e5a-08240fac5aa8 req-f78cbe0e-b456-4153-8607-7c6279e39446 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093277 Sep 06 16:25:27.107901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 526/1018] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:27.961714 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:27.962344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:27.968837 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:27.969322 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:27.969749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:27.970432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:27.970903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:27.971318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:28.106938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:28.114529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3909eccf-d70d-463c-946a-902a87a8542a tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.156846 Sep 06 16:25:28.115286 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 493/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:27 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:29.138388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:29.139126 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:29.146448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:29.146960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:29.147400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:29.148090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:29.148545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:29.148969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:29.285417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:29.293096 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bdf40641-5e45-4e89-98a1-1277985e0994 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1367 microversion: 2.1 time: 0.159346 Sep 06 16:25:29.293669 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 527/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:29 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:30.316974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:30.317502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:30.323968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:30.324453 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:30.325178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:30.325902 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:30.326355 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:30.326812 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:30.465032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:25:30.474390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c648ee85-d29d-49d6-a057-68c02abe9e9d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1556 microversion: 2.1 time: 0.161589 Sep 06 16:25:30.475102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 494/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:25:30 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:25:30.497074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:25:30.497598 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:25:30.504461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:30.504639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:30.505021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:30.505711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:30.506161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:30.506596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:30.586230 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-40f835c7-98b6-4bc4-bd52-ca1d031b3ded tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093025 Sep 06 16:25:30.586860 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 528/1022] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Sep 6 16:25:30 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:25:31.780863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-3a943988-b757-4e0e-8761-6f9acf7d98b9 req-6a7c0206-393b-4ad1-ba3d-abb02e4fed29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e96833-c75c-4637-8c58-21bf3949a7f8", "tag": "439668dc-55d5-469b-881b-b0a33d7fae1e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:25:31.791765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3a943988-b757-4e0e-8761-6f9acf7d98b9 req-6a7c0206-393b-4ad1-ba3d-abb02e4fed29 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:25:31.792247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3a943988-b757-4e0e-8761-6f9acf7d98b9 req-6a7c0206-393b-4ad1-ba3d-abb02e4fed29 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:25:31.792679 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-3a943988-b757-4e0e-8761-6f9acf7d98b9 req-6a7c0206-393b-4ad1-ba3d-abb02e4fed29 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:25:31.805187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-3a943988-b757-4e0e-8761-6f9acf7d98b9 req-6a7c0206-393b-4ad1-ba3d-abb02e4fed29 service nova] Creating event network-changed:439668dc-55d5-469b-881b-b0a33d7fae1e for instance 49e96833-c75c-4637-8c58-21bf3949a7f8 on hv-cinder-85220 Sep 06 16:25:31.811017 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-3a943988-b757-4e0e-8761-6f9acf7d98b9 req-6a7c0206-393b-4ad1-ba3d-abb02e4fed29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033798 Sep 06 16:25:31.811765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 495/1023] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:09.240092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=19 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:09.241200 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=50 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:09.243043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:09.243642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:09.245646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-94dc35c5-ecd3-414e-b46d-499badb1b5ee req-a35e0300-b747-468d-b201-5b47b07dfc45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc7093e-ac27-4690-84d8-033d4912129e", "tag": "ef59344c-d6c6-4288-bbb7-4716d65ba16e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:09.246824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:09.247602 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=50 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:09.255920 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:09.256755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:09.257280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:09.257796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-94dc35c5-ecd3-414e-b46d-499badb1b5ee req-a35e0300-b747-468d-b201-5b47b07dfc45 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:09.258055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:09.258349 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-94dc35c5-ecd3-414e-b46d-499badb1b5ee req-a35e0300-b747-468d-b201-5b47b07dfc45 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:09.258545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:09.258938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-94dc35c5-ecd3-414e-b46d-499badb1b5ee req-a35e0300-b747-468d-b201-5b47b07dfc45 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:09.259726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:09.272104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-94dc35c5-ecd3-414e-b46d-499badb1b5ee req-a35e0300-b747-468d-b201-5b47b07dfc45 service nova] Creating event network-changed:ef59344c-d6c6-4288-bbb7-4716d65ba16e for instance fdc7093e-ac27-4690-84d8-033d4912129e on hv-cinder-85220 Sep 06 16:26:09.277579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-94dc35c5-ecd3-414e-b46d-499badb1b5ee req-a35e0300-b747-468d-b201-5b47b07dfc45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039746 Sep 06 16:26:09.278199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 496/1024] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:26:09.293423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:26:09.391087 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-56a9be52-90d0-4382-b085-e6b2088837b5 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 204 len: 0 microversion: 2.1 time: 0.156152 Sep 06 16:26:09.396543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 529/1025] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:26:09 2022] DELETE /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:26:09.403197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:09.404232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:09.413360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:09.413857 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:09.414294 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:09.415105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:09.415560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:09.415985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:09.558778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:09.570418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fd0420e4-7824-466c-9a40-7749036bd28d tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.172501 Sep 06 16:26:09.571088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 497/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:26:09 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:26:10.596666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:10.598246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:10.607605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:10.608159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:10.608668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:10.609453 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:10.609906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:10.610334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:10.763579 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:10.772606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-70c3fa82-3d97-4774-b741-de80e037152b tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1567 microversion: 2.1 time: 0.181184 Sep 06 16:26:10.773189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 530/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:26:10 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:26:11.796593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:11.797209 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:11.804416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:11.804909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:11.805354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:11.806058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:11.806517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:11.806966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:12.026203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:12.034558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c1cd7818-1ff2-47ca-ae1e-88b4d78f9744 tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1449 microversion: 2.1 time: 0.241645 Sep 06 16:26:12.036125 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 498/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:26:11 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1449 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:26:12.201241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-cbaea6d0-4f39-477a-96e1-8dbdc5ceb487 req-4264e0e6-4a61-460c-a4db-147c95cfea00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc7093e-ac27-4690-84d8-033d4912129e", "name": "network-vif-deleted", "tag": "ef59344c-d6c6-4288-bbb7-4716d65ba16e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:12.212901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cbaea6d0-4f39-477a-96e1-8dbdc5ceb487 req-4264e0e6-4a61-460c-a4db-147c95cfea00 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:12.213380 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cbaea6d0-4f39-477a-96e1-8dbdc5ceb487 req-4264e0e6-4a61-460c-a4db-147c95cfea00 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:12.213811 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cbaea6d0-4f39-477a-96e1-8dbdc5ceb487 req-4264e0e6-4a61-460c-a4db-147c95cfea00 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:12.226539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-cbaea6d0-4f39-477a-96e1-8dbdc5ceb487 req-4264e0e6-4a61-460c-a4db-147c95cfea00 service nova] Creating event network-vif-deleted:ef59344c-d6c6-4288-bbb7-4716d65ba16e for instance fdc7093e-ac27-4690-84d8-033d4912129e on hv-cinder-85220 Sep 06 16:26:12.233764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-cbaea6d0-4f39-477a-96e1-8dbdc5ceb487 req-4264e0e6-4a61-460c-a4db-147c95cfea00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036420 Sep 06 16:26:12.234392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 531/1029] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:13.061340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:13.061961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:13.077528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:13.078886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:13.079609 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:13.080710 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:13.081744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:13.082592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:13.153812 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:13.154947 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:13.155785 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:13.156643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lazy-loading 'fault' on Instance uuid fdc7093e-ac27-4690-84d8-033d4912129e {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:26:13.205807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0eaab966616458592a89cdef9cf63c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf281d8694e486da6d616fe43107474', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:13.209866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:13.210720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:13.215559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cd374042-f9c2-45e1-88d9-f4c2cf9f8c2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 200 len: 1224 microversion: 2.1 time: 0.158622 Sep 06 16:26:13.216176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 499/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:26:13 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 1224 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:26:13.218132 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:13.218621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:13.219103 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:13.219828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:13.220290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:13.220714 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:13.249277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-78a21fb9-0db5-4685-865b-b43f0f165db8 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/ips" status: 200 len: 149 microversion: 2.20 time: 0.043791 Sep 06 16:26:13.249884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 532/1031] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Sep 6 16:26:13 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 16:26:14.240716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:14.241345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] [instance: fdc7093e-ac27-4690-84d8-033d4912129e] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:14.251415 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:14.251904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:14.252338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:14.253044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:14.253500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:14.253965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:14.269010 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] HTTP exception thrown: Instance fdc7093e-ac27-4690-84d8-033d4912129e could not be found. Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Request method failure captured: Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e HTTP/1.1 Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Kv5Py8__8KnSGMioMLSCwarD0WKL1jW3WSQS-cBFKGSmtdbjC50A6yOfjW21uFKdj6F_Wjqb_eT3A6xNVX7OwdqaVi-auM5xMLk_RcE6jDK7sz66dLEhn7IjmSc2JQ_zzQ7fDMLwR3sxrOubGcSSeqneOHToyTWoNfDFAYv5_zzaI Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: abf281d8694e486da6d616fe43107474 Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-TestShelveInstance-526847001 Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:26:14.271383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/abf281d8694e486da6d616fe43107474"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_abf281d8694e486da6d616fe43107474"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/abf281d8694e486da6d616fe43107474"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/abf281d8694e486da6d616fe43107474"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-TestShelveInstance-526847001 Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: abf281d8694e486da6d616fe43107474 Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-TestShelveInstance-526847001 Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-TestShelveInstance-526847001-project Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: e0eaab966616458592a89cdef9cf63c3 Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-TestShelveInstance-526847001-project Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance fdc7093e-ac27-4690-84d8-033d4912129e could not be found. Sep 06 16:26:14.273013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': 'fdc7093e-ac27-4690-84d8-033d4912129e'} Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc7093e-ac27-4690-84d8-033d4912129e could not be found. Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:26:14.273939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc7093e-ac27-4690-84d8-033d4912129e could not be found. Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc7093e-ac27-4690-84d8-033d4912129e could not be found. Sep 06 16:26:14.275292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:26:14.276510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Returning 404 to user: Instance fdc7093e-ac27-4690-84d8-033d4912129e could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:26:14.276510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d59444d3-b3d6-4c11-91eb-3ae9346ae8aa tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e" status: 404 len: 111 microversion: 2.1 time: 0.036144 Sep 06 16:26:14.276510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 500/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:26:14 2022] GET /compute/v2.1/servers/fdc7093e-ac27-4690-84d8-033d4912129e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:26:14.447383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e14f093e-297b-4cbb-a2fb-a9a069da8a2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] Calling method '.version_select at 0x7f21b3eaed30>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:14.469431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e14f093e-297b-4cbb-a2fb-a9a069da8a2f tempest-TestShelveInstance-526847001 tempest-TestShelveInstance-526847001-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-357680795" status: 202 len: 0 microversion: 2.1 time: 0.025702 Sep 06 16:26:14.470041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 533/1033] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 6 16:26:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-357680795 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:26:15.382408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:15.383048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:15.389798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:15.390289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:15.390765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:15.391483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:15.391948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:15.392376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:15.419260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lazy-loading 'flavor' on Instance uuid 2891ad36-504d-4c32-a783-6d93e3a4b43b {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:26:15.652862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-15f24b29-0380-48a6-b5ed-0d15bfe1271d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/action" status: 202 len: 0 microversion: 2.20 time: 0.274843 Sep 06 16:26:15.653974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 501/1034] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Sep 6 16:26:15 2022] POST /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:26:15.670029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:15.670684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:15.681767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:15.682563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:15.683336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:15.684111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:15.684762 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:15.685479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:15.923553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:15.931976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:15.933472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:15.934648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-17779bdb-5469-40a0-b141-c2fc806ccbe3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.276300 Sep 06 16:26:15.935236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 534/1035] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:15 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:16.961949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:16.962737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:16.969301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:16.969792 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:16.970232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:16.970989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:16.971518 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:16.971942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:17.123789 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:17.134507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:17.136221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:17.137495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0ae31fa6-bf42-42a3-ba3e-fb203695c1f9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.181059 Sep 06 16:26:17.138027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 502/1036] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:16 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:18.167095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:18.167728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:18.174531 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:18.175047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:18.175485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:18.176688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:18.177138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:18.177563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:18.413060 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:18.421643 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:18.423134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:18.424278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-11f9161d-9fd4-4ddb-9c0e-9c9d40dbb3c7 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.262690 Sep 06 16:26:18.424836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 535/1037] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:18 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:19.457097 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:19.458225 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:19.469085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:19.469582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:19.470027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:19.470796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:19.471260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:19.471696 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:19.628900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:19.639847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:19.642119 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:19.643722 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-50b13962-ce78-4875-8bbe-fb96a4b180c6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.194339 Sep 06 16:26:19.645057 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 503/1038] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:19 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:20.676165 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:20.677866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:20.688402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:20.689079 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:20.689680 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:20.690765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:20.691671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:20.692628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:20.995587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:21.008586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:21.010283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:21.012145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7623c791-9bc7-4d6b-94a3-14b01c53196a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.343388 Sep 06 16:26:21.013449 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 536/1039] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:20 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:22.040560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:22.041159 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:22.053844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:22.054347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:22.054833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:22.055572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:22.056048 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:22.056480 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:22.274535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:22.291301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:22.295208 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:22.298099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-6511e1a7-6fd0-4d7c-ad1e-d64fbabe9e21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.261691 Sep 06 16:26:22.299648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 504/1040] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:22 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:23.326573 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:23.327226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:23.334743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:23.335153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:23.335616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:23.336291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:23.336842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:23.337326 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:23.490804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:23.499789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:23.501307 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:23.502577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4b491373-ca7c-494c-8fa2-2dba44cd2863 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.180487 Sep 06 16:26:23.503238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 537/1041] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:23 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:24.529494 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:24.530144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:24.538582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:24.539107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:24.539558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:24.540282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:24.540762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:24.541201 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:24.785540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:24.794726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:24.796216 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:24.797424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dd9099df-15fc-4c87-af33-e9d6b91ad185 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.272102 Sep 06 16:26:24.797994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 505/1042] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:24 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:25.831907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:25.833125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:25.845544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:25.846212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:25.846967 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:25.848178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:25.848843 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:25.849402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:26.133950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:26.142973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:26.144728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:26.146041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-02772cb6-806c-4e50-8190-262691b61559 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.321563 Sep 06 16:26:26.146877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 538/1043] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:25 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:27.176934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:27.178290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:27.185862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:27.186359 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:27.186846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:27.187567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:27.188024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:27.188451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:27.421372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:27.430857 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:27.432438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:27.433642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1df757fa-c9e4-4916-bd83-9783d1922bbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.261426 Sep 06 16:26:27.434405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 506/1044] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:27 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:28.470084 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:28.475024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:28.494227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:28.495526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:28.496420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:28.498240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:28.499696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:28.501880 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:28.851017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:28.866150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:28.868503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:28.870067 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d607d0a5-f1ac-4a0e-a0ed-4ee8cc8576f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.410066 Sep 06 16:26:28.883191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 539/1045] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:28 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:29.900735 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:29.900735 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:29.908397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:29.909242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:29.909681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:29.910573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:29.911275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:29.911755 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:30.078194 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:30.088712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:30.090251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:30.091510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2a99b7a8-0934-4831-b272-b8d3db775ef1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.197516 Sep 06 16:26:30.102500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 507/1046] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:29 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:31.125547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:31.126283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:31.140923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:31.142650 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:31.143429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:31.147067 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:31.147847 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:31.148763 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:31.451275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:31.463507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:31.465438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:31.467124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4103c5d0-40e4-47c8-b140-c402ed9ca51f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.346526 Sep 06 16:26:31.468302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 540/1047] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:31 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:32.505665 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:32.506285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:32.512590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:32.513081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:32.513514 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:32.514215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:32.514718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:32.515107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:32.784561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:32.797191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:32.814834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:32.816481 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-38e92b27-7ed4-4386-ad7e-c7445ef25532 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1741 microversion: 2.20 time: 0.323708 Sep 06 16:26:32.817600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 508/1048] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:32 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:33.854027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:33.855293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:33.869264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:33.869777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:33.870223 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:33.871101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:33.871561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:33.871982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:34.090778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:34.101127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:34.103095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:34.104622 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d83c424e-7c26-4cbe-a224-65f0a2dc006d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1741 microversion: 2.20 time: 0.254458 Sep 06 16:26:34.105739 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 541/1049] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:33 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:35.138423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:35.141885 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:35.156190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:35.157529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:35.158678 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:35.160909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:35.166331 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:35.167639 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:35.417925 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:35.428877 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:35.431518 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:35.434333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9dc23e56-4d46-443b-b6c3-0d7207633bc4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1741 microversion: 2.20 time: 0.303216 Sep 06 16:26:35.436950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 509/1050] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:35 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1741 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:35.651034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:35.652965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d594d8fd-2a13-4beb-885b-fed98e925520 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Action: 'create', calling method: .version_select at 0x7f21b3f978b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-212657060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSMJFl855HZ+NfSxSSyHRVjw0xUGUPFfsGGX9DWtoRtMYwtLpv3stKMtGeDXEAGqV21eB9mw/W4uS5PxPw89yX/OOfEFJ3gcrG9RuffyoapGijghTck7LppTFt/w4qYpA=="}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:35.659444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:35.667404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:35.667900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:35.668342 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:35.669076 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:35.669563 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:35.670226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:35.688457 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-d594d8fd-2a13-4beb-885b-fed98e925520 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:26:35.698466 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-d594d8fd-2a13-4beb-885b-fed98e925520 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for user 210d0f461d2c445a9688bc233d048079 and project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'key_pairs'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:26:35.709361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a6a7441-ec16-4abd-869a-c68b9a4d0d02 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/ips" status: 200 len: 145 microversion: 2.1 time: 0.540899 Sep 06 16:26:35.711246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 542/1051] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:26:35 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/ips => generated 145 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:35.728514 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d594d8fd-2a13-4beb-885b-fed98e925520 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.275435 Sep 06 16:26:35.729140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 510/1052] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 6 16:26:35 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:36.475281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:36.479085 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:36.498134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:36.499792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:36.500929 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:36.504443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:36.505059 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:36.506072 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:36.788483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:36.798621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:36.802162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:36.803944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-09e44ad4-de61-4546-a3bd-848254893c20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1741 microversion: 2.20 time: 0.337565 Sep 06 16:26:36.804890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 543/1053] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:36 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1741 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:37.481526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-430e8d3b-6b00-4ac1-8e64-1654ff69ca3d req-b8796cd1-60e3-472d-a014-0573a618a931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2891ad36-504d-4c32-a783-6d93e3a4b43b", "name": "network-vif-plugged", "status": "completed", "tag": "a96c2f08-a914-47c2-b41e-30eb8c3f0faa"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:37.505874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-430e8d3b-6b00-4ac1-8e64-1654ff69ca3d req-b8796cd1-60e3-472d-a014-0573a618a931 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:37.506405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-430e8d3b-6b00-4ac1-8e64-1654ff69ca3d req-b8796cd1-60e3-472d-a014-0573a618a931 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:37.506928 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-430e8d3b-6b00-4ac1-8e64-1654ff69ca3d req-b8796cd1-60e3-472d-a014-0573a618a931 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:37.518838 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-430e8d3b-6b00-4ac1-8e64-1654ff69ca3d req-b8796cd1-60e3-472d-a014-0573a618a931 service nova] Creating event network-vif-plugged:a96c2f08-a914-47c2-b41e-30eb8c3f0faa for instance 2891ad36-504d-4c32-a783-6d93e3a4b43b on hv-cinder-85220 Sep 06 16:26:37.525392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-430e8d3b-6b00-4ac1-8e64-1654ff69ca3d req-b8796cd1-60e3-472d-a014-0573a618a931 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048596 Sep 06 16:26:37.526495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 511/1054] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:37.853586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:37.855328 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:37.862607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:37.863695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:37.864216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:37.864970 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:37.865579 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:37.866007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:38.019732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:38.033772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:38.037413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:38.039462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-629661ad-b2f5-4c66-b22e-1dc6b2865cbc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1741 microversion: 2.20 time: 0.189870 Sep 06 16:26:38.040448 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 544/1055] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:37 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:38.497820 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55fa3c62-5fe6-4102-9bdc-576fb0b5c349"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:38.501934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:38.515444 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:38.516342 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:38.517131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:38.518458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:38.519876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:38.520682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:38.877593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:39.082169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:39.083695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:39.095953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:39.096939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:39.098214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:39.099544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:39.100282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:39.101044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:39.131000 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c9c1fc6e-0a69-44f7-b723-1d1567551054 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.639342 Sep 06 16:26:39.135425 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 512/1056] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:26:38 2022] POST /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments => generated 194 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:26:39.343897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:39.561074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:39.573928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:39.575748 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:39.577876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-709e2aed-ee8f-479f-8549-0da16bea328f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.500131 Sep 06 16:26:39.578560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 545/1057] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:39 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:40.608631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:40.609652 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:40.614381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:40.632105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:40.632828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:40.633396 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:40.634521 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:40.635350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:40.636208 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:40.812642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:40.823314 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:40.825243 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:40.827056 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-81e7fd09-bd3c-4054-9bff-b76b5de85ca3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.224790 Sep 06 16:26:40.828449 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 513/1058] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:40 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:41.862129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:41.864248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:41.867404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:41.874296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:41.876112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:41.876954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:41.878097 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:41.879193 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:41.880244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:42.071432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:42.081957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:42.084207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:42.085591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-41df5b38-6dea-4511-81d3-02efe26ac7b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.228756 Sep 06 16:26:42.086971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 546/1059] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:41 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:43.134833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:43.140220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:43.152236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:43.153508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:43.154320 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:43.155705 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:43.156476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:43.157321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:43.448238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:43.460507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:43.461989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:43.463229 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1905345c-21a9-4bd4-a7c0-544401c6fefd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.332765 Sep 06 16:26:43.464013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 514/1060] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:43 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:44.494283 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:44.495416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:44.507234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:44.507877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:44.508538 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:44.509379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:44.510160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:44.510843 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:44.696556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:44.706231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:44.707958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:44.709238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a59be30b-3746-422c-a141-d1e973498404 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.223101 Sep 06 16:26:44.727254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 547/1061] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:44 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:45.745117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:45.746100 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:45.750259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=4 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:26:45.760105 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:45.760733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:45.761939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:45.763198 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:45.763700 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:45.764154 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:45.962067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:45.970917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:45.972730 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:45.974027 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-72b1fbae-27aa-43c6-b6cb-aa52ac303b53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.232852 Sep 06 16:26:45.986001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 515/1062] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:45 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:47.006247 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:47.007216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:47.014519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:47.015247 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:47.015883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:47.016841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:47.017769 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:47.018316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:47.152705 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:47.156893 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:47.170296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:47.171579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:47.172638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:47.173937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:47.175090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:47.175972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:47.241712 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b466bae5-4e23-4686-8e5e-d811e7311134 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096563 Sep 06 16:26:47.241990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:47.245921 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 516/1063] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:26:47 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:47.259305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:47.259604 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:47.260009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:47.262903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:47.265686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8c254dbd-105f-4fad-a178-080ac21e4b33 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.264608 Sep 06 16:26:47.267158 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:47.267773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:47.268439 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:47.270739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:47.271398 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:47.271986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:47.283396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 548/1064] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:46 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:47.336926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-24a78688-327e-425f-8fdc-1861c34dbcd1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/55fa3c62-5fe6-4102-9bdc-576fb0b5c349" status: 200 len: 194 microversion: 2.1 time: 0.083183 Sep 06 16:26:47.337828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 517/1065] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Sep 6 16:26:47 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/55fa3c62-5fe6-4102-9bdc-576fb0b5c349 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:26:48.308423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:48.309211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:48.318402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:48.319177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:48.319911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:48.320895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:48.321667 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:48.322274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:48.479392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:48.488863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:48.490326 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:48.491543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e11dbdf4-1508-4db1-a2c4-2d2337b548fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.187392 Sep 06 16:26:48.492144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 549/1066] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:48 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:48.868219 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "896023f0-41df-435c-8a9e-2b4e4c6a24f3"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:48.872061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:48.883889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:48.885167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:48.885817 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:48.886676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:48.887357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:48.888084 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:49.288022 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b5c60c22-2770-493d-9662-50dfe6f9a915 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "POST /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429154 Sep 06 16:26:49.288942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 518/1067] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:26:48 2022] POST /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:49.522752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:49.524200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:49.531369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:49.531889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:49.532520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:49.533007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:49.533461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:49.533885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:49.689103 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:49.698886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:49.700515 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:49.702124 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4533f6f6-b715-4c33-a496-8b88f5c7569f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.184290 Sep 06 16:26:49.703135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 550/1068] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:49 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:50.731014 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:50.731839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:50.738598 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:50.739198 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:50.739638 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:50.740406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:50.740855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:50.741278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:50.923488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:50.937183 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:50.940439 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:50.945129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e8b59cf5-a4ee-4f83-a4c0-70b4f38bf1c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.219345 Sep 06 16:26:50.950146 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 519/1069] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:50 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:51.998405 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:51.999950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:52.007784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:52.008795 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:52.009856 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:52.010841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:52.011466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:52.012220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:52.180916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:52.190105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:52.191902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:52.193199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-74fbaae3-bae2-4c09-96d3-453d690e6fec tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.198681 Sep 06 16:26:52.193984 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 551/1070] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:51 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:53.222138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:53.222806 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:53.230430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:53.230954 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:53.231416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:53.232133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:53.232643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:53.233075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:53.458171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:53.471655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:53.473727 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:53.475388 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0fbea381-59e0-44c9-be5f-a5297625b3b9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.256979 Sep 06 16:26:53.476706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 520/1071] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:53 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:54.529861 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:54.532486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:54.546692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:54.548102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:54.548679 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:54.550200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:54.551213 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:54.552154 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:54.746344 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:54.756684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:54.758145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:54.759402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-98369858-944e-4ec7-b326-b9c9d8b573d6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.236909 Sep 06 16:26:54.779017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 552/1072] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:54 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:55.786827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:55.787427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:55.794148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:55.794622 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:55.795093 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:55.795798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:55.796245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:55.796666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:55.934893 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:55.947956 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:55.949512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:55.950801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5cfbe1c5-1b1c-4a45-9dcf-df7fded62622 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.168769 Sep 06 16:26:55.951364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 521/1073] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:55 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:56.979240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:56.979866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:56.986610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:56.987129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:56.987583 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:56.988855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:56.989414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:56.989841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:57.135828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:57.144925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:57.146381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:57.147608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-32d54dfe-8df7-4c4f-bb61-15cebbe798a3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1736 microversion: 2.20 time: 0.173130 Sep 06 16:26:57.148231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 553/1074] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:56 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:26:58.178862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:58.179487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:58.186633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:58.187228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:58.187767 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:58.188654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:58.189153 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:58.189616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:58.447927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:58.466855 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:58.470035 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:58.472116 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d78dead3-2998-40a9-865a-c9a29e19cf53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1718 microversion: 2.20 time: 0.298424 Sep 06 16:26:58.473165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 522/1075] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:58 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1718 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:26:59.166323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:59.168600 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:59.175916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.176407 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.176848 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.177555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.178147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.178582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.211684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2afab154-218b-44b8-bafe-4a034da2396c tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049236 Sep 06 16:26:59.212259 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 554/1076] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:26:59 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:59.359465 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:59.360085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:59.367326 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.367815 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.368258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.368974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.369433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.369864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.403656 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-68ca6cf9-c757-492e-8615-c138f551cd70 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/55fa3c62-5fe6-4102-9bdc-576fb0b5c349" status: 200 len: 194 microversion: 2.1 time: 0.049294 Sep 06 16:26:59.404187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 523/1077] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Sep 6 16:26:59 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/55fa3c62-5fe6-4102-9bdc-576fb0b5c349 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:59.415115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:59.415616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:59.422182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.422693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.423130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.423846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.424301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.424726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.515006 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:26:59.515628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:26:59.518849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'services' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:26:59.522725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.522725 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.523185 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.523801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.524261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.524692 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.664981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a73b378-53f6-4087-8f57-c86a1c484b99 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/55fa3c62-5fe6-4102-9bdc-576fb0b5c349" status: 202 len: 0 microversion: 2.1 time: 0.253275 Sep 06 16:26:59.665472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 555/1078] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:26:59 2022] DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/55fa3c62-5fe6-4102-9bdc-576fb0b5c349 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:26:59.676252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-af701d4a-fda8-4520-b446-e60324226487 req-644d4081-5933-4987-a34b-af4b575d60ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2891ad36-504d-4c32-a783-6d93e3a4b43b", "name": "network-vif-unplugged", "status": "completed", "tag": "a96c2f08-a914-47c2-b41e-30eb8c3f0faa"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:26:59.690442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-af701d4a-fda8-4520-b446-e60324226487 req-644d4081-5933-4987-a34b-af4b575d60ff service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:26:59.693768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-af701d4a-fda8-4520-b446-e60324226487 req-644d4081-5933-4987-a34b-af4b575d60ff service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:26:59.693946 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-af701d4a-fda8-4520-b446-e60324226487 req-644d4081-5933-4987-a34b-af4b575d60ff service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:26:59.708544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-af701d4a-fda8-4520-b446-e60324226487 req-644d4081-5933-4987-a34b-af4b575d60ff service nova] Creating event network-vif-unplugged:a96c2f08-a914-47c2-b41e-30eb8c3f0faa for instance 2891ad36-504d-4c32-a783-6d93e3a4b43b on hv-cinder-85220 Sep 06 16:26:59.715430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-af701d4a-fda8-4520-b446-e60324226487 req-644d4081-5933-4987-a34b-af4b575d60ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048067 Sep 06 16:26:59.716613 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 556/1079] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:26:59.755671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:59.765484 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:59.767410 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:26:59.768621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-405942a9-10be-46ef-9196-d191c74980a5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1718 microversion: 2.20 time: 0.257570 Sep 06 16:26:59.769219 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 524/1080] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:26:59 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1718 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:00.802576 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:00.804991 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:00.816749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:00.817825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:00.818532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:00.819857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:00.820831 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:00.821552 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:00.974998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:00.986824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:00.989547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:00.991635 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2194f7df-8277-47da-a3c4-5e4a730be31c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1718 microversion: 2.20 time: 0.199245 Sep 06 16:27:00.992523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 557/1081] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:00 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1718 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:02.030592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:02.031507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:02.039687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.040195 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.040634 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:02.041364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.041821 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.042263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:02.254261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:02.267548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:02.269392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:02.271370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8dbe5772-99c0-452c-949b-c929f7ea1e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1721 microversion: 2.20 time: 0.245367 Sep 06 16:27:02.272093 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 525/1082] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:02 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:02.319657 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a3c6039-a767-4ddc-bfa2-ec297cc2c7e0"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:02.323212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:02.331863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.332488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.332926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:02.333682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.334148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.334608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:02.688685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4f44131b-36d5-4a01-b35d-b0e76341f117 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.376585 Sep 06 16:27:02.702044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 558/1083] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Sep 6 16:27:02 2022] POST /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments => generated 188 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:27:02.860532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:02.861187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:02.869149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.869666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.870133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:02.871049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.871604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.872094 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:02.905765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120738) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 16:27:02.948945 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:02.981942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:02.982589 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:02.990458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9e8013d3-d47f-4b09-93e4-4ece1c328bea tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/action" status: 202 len: 0 microversion: 2.20 time: 0.134099 Sep 06 16:27:02.995497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 526/1084] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Sep 6 16:27:02 2022] POST /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 16:27:02.995809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.995809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.995809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:02.995809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:02.996359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:02.996359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:03.004508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:03.005512 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:03.013223 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:03.016802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:03.017251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:03.017707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:03.018452 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:03.019050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:03.019608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:03.040034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2d6b466f-0a67-457c-a23c-e40459d823f3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/896023f0-41df-435c-8a9e-2b4e4c6a24f3" status: 200 len: 194 microversion: 2.1 time: 0.064152 Sep 06 16:27:03.047456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 559/1085] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Sep 6 16:27:02 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/896023f0-41df-435c-8a9e-2b4e4c6a24f3 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:03.055209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:03.055907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:03.064359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:03.065471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:03.065471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:03.066313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:03.067038 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:03.069696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:03.173685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'services' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:03.189203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:03.207428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:03.209392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:03.212180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-62a063eb-102e-4dee-af1c-fc08e42318b4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1747 microversion: 2.20 time: 0.214568 Sep 06 16:27:03.213021 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 527/1086] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:02 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1747 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:03.263982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3cd26ea8-781f-464b-9fd1-c152461fbbca tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/896023f0-41df-435c-8a9e-2b4e4c6a24f3" status: 202 len: 0 microversion: 2.1 time: 0.214156 Sep 06 16:27:03.267183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 560/1087] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:27:03 2022] DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments/896023f0-41df-435c-8a9e-2b4e4c6a24f3 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:27:04.108906 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905017718", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-212657060", "security_groups": [{"name": "tempest-secgroup-smoke-1209426615"}], "block_device_mapping_v2": [{"uuid": "a8ec68a0-abe8-439f-9d21-fff9b8c9459b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8447cde-2775-41af-9b27-fe16e441705f"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:04.241206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:04.243223 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:04.255690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.256298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.256805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.258444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.258926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.259533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.304226 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] validate_networks() for [('e8447cde-2775-41af-9b27-fe16e441705f', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:27:04.461311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:04.471886 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:04.473959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:04.475280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cb66e755-9af8-4d28-9cfd-e7250bb1dfd2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1749 microversion: 2.20 time: 0.240150 Sep 06 16:27:04.476012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 561/1088] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:04 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1749 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:04.516032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:04.519804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:04.526704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.527201 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.527636 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.528368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.528867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.529240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.568252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8fd20fe4-79d3-40a8-b6cb-47107f2d29e0 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056314 Sep 06 16:27:04.569025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 562/1089] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:04 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 16:27:04.699971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:04.702424 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:04.709620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.710023 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.710468 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.711245 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.711720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.712145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.750701 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-82ff2b79-c16b-4983-bd85-cd899276d1b6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054574 Sep 06 16:27:04.751572 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 563/1090] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:04 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 16:27:04.830839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:04.831367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:04.839024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.839526 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.840064 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.840818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.841277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.841741 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:04.874166 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:27:04.973807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7fa3832e-06de-4f4b-8d51-b973a8665b52 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 204 len: 0 microversion: 2.1 time: 0.145879 Sep 06 16:27:04.979723 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 564/1091] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:04 2022] DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 16:27:04.988214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:04.990425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:04.998030 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:04.998519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:04.999149 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:05.000615 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:05.001110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:05.001556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:05.316295 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:27:05.317300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:27:05.317300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:27:05.317957 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:27:05.318547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:27:05.329474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:05.330051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:05.330566 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:05.331438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:05.331997 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:05.332503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:05.353459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:27:05.358477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for user 210d0f461d2c445a9688bc233d048079 and project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:27:05.457409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:05.471254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-af22f785-8df1-4ec2-8d10-1dc977cce388 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1670 microversion: 2.1 time: 0.489175 Sep 06 16:27:05.472246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 565/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:04 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1670 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:05.475515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:27:05.477773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8ec68a0-abe8-439f-9d21-fff9b8c9459b',volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:27:05.512778 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:05.513926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:05.523931 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:05.524621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:05.525458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:05.526291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:05.526787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:05.527412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:05.656641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-16880a21-e675-44ae-ae0d-25d65d3b839f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.552246 Sep 06 16:27:05.657758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 528/1093] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:27:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:27:05.679701 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-786ee2db-bd35-4dcd-9c53-30789328eb3b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:05.681238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-786ee2db-bd35-4dcd-9c53-30789328eb3b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:05.744804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:05.758203 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:05.761385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:05.763083 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4e27f3c1-2a6a-4618-b15d-6939bcf31e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1749 microversion: 2.20 time: 0.257618 Sep 06 16:27:05.765456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 566/1094] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:05 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:05.788791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-786ee2db-bd35-4dcd-9c53-30789328eb3b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:05.802892 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-786ee2db-bd35-4dcd-9c53-30789328eb3b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1094 microversion: 2.1 time: 0.131710 Sep 06 16:27:05.803580 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 529/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:05 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1094 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:06.501952 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:06.502617 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:06.510178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.510693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.511188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.511927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.512382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.512810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.727545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:06.740151 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c8160871-afcc-4cc6-a66a-7ea01e83c069 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1670 microversion: 2.1 time: 0.242254 Sep 06 16:27:06.740938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 567/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:06 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:06.805237 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:06.806407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:06.820548 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.821782 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.822765 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.824039 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.825318 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.826061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.829795 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:06.830416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:06.840241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.840734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.841420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.842148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:06.842604 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:06.843210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:06.950239 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:06.961474 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-467d4611-8999-4de5-8b6a-44f3647bd615 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1136 microversion: 2.1 time: 0.135882 Sep 06 16:27:06.963112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 568/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:06 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1136 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:07.031886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:07.043064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:07.044680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:07.046023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-eca99140-053d-4769-aed1-5f5485315c1a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.248109 Sep 06 16:27:07.046599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 530/1098] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:06 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:07.766467 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:07.767368 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:07.774429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:07.774948 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:07.775382 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:07.776101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:07.776546 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:07.776999 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:07.989555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:07.996593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:07.997469 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:08.002054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cf55f248-6d07-4c83-bacc-1be23f7b8af9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1670 microversion: 2.1 time: 0.240052 Sep 06 16:27:08.003020 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 569/1099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:07 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1670 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:08.008203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:08.009087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:08.009699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:08.011121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:08.011780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:08.012431 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:08.074953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:08.075578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:08.084246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:08.084743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:08.085179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:08.086097 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:08.087292 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:08.087907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:08.280625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:08.291533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:08.293062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:08.294331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-14a89f53-4069-4bd0-9a6f-e612fb5a2aa9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.223647 Sep 06 16:27:08.303485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 570/1100] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:08 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:08.321683 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:08.339354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-95cfda7e-136f-40bf-ab82-340f9cfedcdd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1200 microversion: 2.1 time: 0.349591 Sep 06 16:27:08.340938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 531/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:07 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1200 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:09.037900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:09.039132 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:09.056253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:09.057824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:09.058642 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:09.061403 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:09.064314 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:09.065157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:09.165181 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-ffd3f1d3-2527-47e7-b3b9-413523e2e3ae req-c66d19f4-cfbb-4809-a3dc-2024b8bbd48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cb0205-745c-4ec5-8e7f-be4abd758c3d", "name": "network-vif-deleted", "tag": "e6418311-8073-44d1-86e5-dc002799f972"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:09.173167 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:09.186567 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c96f8502-a2b4-4dcc-86af-f406e0b8c894 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1603 microversion: 2.1 time: 0.160463 Sep 06 16:27:09.187550 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 571/1102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:09 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1603 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:09.216874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ffd3f1d3-2527-47e7-b3b9-413523e2e3ae req-c66d19f4-cfbb-4809-a3dc-2024b8bbd48f service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:09.223575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ffd3f1d3-2527-47e7-b3b9-413523e2e3ae req-c66d19f4-cfbb-4809-a3dc-2024b8bbd48f service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:09.224398 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-ffd3f1d3-2527-47e7-b3b9-413523e2e3ae req-c66d19f4-cfbb-4809-a3dc-2024b8bbd48f service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:09.248585 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-ffd3f1d3-2527-47e7-b3b9-413523e2e3ae req-c66d19f4-cfbb-4809-a3dc-2024b8bbd48f service nova] Creating event network-vif-deleted:e6418311-8073-44d1-86e5-dc002799f972 for instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d on hv-cinder-85220 Sep 06 16:27:09.259787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-ffd3f1d3-2527-47e7-b3b9-413523e2e3ae req-c66d19f4-cfbb-4809-a3dc-2024b8bbd48f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102988 Sep 06 16:27:09.262029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 532/1103] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:09.324895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:09.326154 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:09.337303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:09.338430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:09.339374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:09.340800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:09.341812 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:09.342732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:09.370718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:09.371949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:09.383744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:09.385809 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:09.386627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:09.388593 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:09.389339 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:09.390180 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:09.532559 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:09.549135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c317d6c7-569d-4de8-887f-f31ff40e0199 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1198 microversion: 2.1 time: 0.184393 Sep 06 16:27:09.558015 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 533/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:09 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1198 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:09.623122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:09.635859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:09.637233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:09.638476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ad1664ee-5fba-4b18-91bc-89b2dd6e6a20 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.320244 Sep 06 16:27:09.662750 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 572/1105] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:09 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:10.235241 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:10.238149 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:10.251138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:10.252554 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:10.254351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:10.256035 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:10.257135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:10.258344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:10.363606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:10.364637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:10.365554 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:10.366513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:10.454889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:10.490499 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-17913af9-83ae-48a7-bdbe-0f831ff315df tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.260170 Sep 06 16:27:10.492319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 534/1106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:10 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:10.606152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:10.606892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:10.626865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:10.627454 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:10.627966 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:10.628822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:10.629358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:10.629866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:10.707676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:10.708833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:10.716230 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:10.724298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:10.725169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:10.725866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:10.726979 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:10.727755 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:10.728489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:10.959852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:10.967785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:10.985072 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:10.994964 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4cfa0892-07f2-461f-8b90-7c03b124b53b tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.387706 Sep 06 16:27:11.000169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 573/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:10 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:11.040941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:11.049187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:11.055619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9722eafc-03fe-4749-ad45-55207b85413c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.359626 Sep 06 16:27:11.083131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 535/1108] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:10 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:11.526522 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:11.527266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:11.539330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:11.540089 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:11.543591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:11.544958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:11.545704 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:11.546260 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:11.603139 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:11.603841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:11.604792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:11.605176 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:11.666822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:11.675547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fadd9f78-5b29-4429-994b-6c3bb03f6763 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.152624 Sep 06 16:27:11.676900 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 574/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:11 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:12.048422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:12.051601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:12.063871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:12.064743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:12.065568 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:12.067383 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:12.068238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:12.068922 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:12.112551 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:12.113985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:12.116950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:12.123759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:12.124539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:12.125148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:12.126126 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:12.126850 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:12.127462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:12.349967 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:12.367291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-27927ac1-9c92-4c02-8a49-2581e59ccc2e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.326881 Sep 06 16:27:12.369467 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 536/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:12 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:12.411740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:12.429302 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:12.432472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:12.434794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-713876ee-0d78-4c6e-88db-59c18169b52b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.331656 Sep 06 16:27:12.436088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 575/1111] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:12 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:12.704218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:12.705091 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:12.712079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:12.712693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:12.713270 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:12.714019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:12.714606 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:12.715141 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:12.771423 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:12.772321 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:12.773221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:12.774158 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:12.836680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:12.842696 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-03057017-033d-4e49-b00a-4b8d85a160c2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.142609 Sep 06 16:27:12.846719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 537/1112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:12 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:13.408079 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:13.408987 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:13.416658 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:13.417155 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:13.417606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:13.418316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:13.418806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:13.419255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:13.480874 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:13.482505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:13.490872 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:13.491407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:13.491884 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:13.492889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:13.493537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:13.494123 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:13.625753 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:13.636944 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b9c8a617-3190-4c91-b0b9-5f32216cf27f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.232940 Sep 06 16:27:13.638148 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 576/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:13 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:13.680415 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:13.690290 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:13.692799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:13.694299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ddc66a01-6f27-4bbe-8cc5-4f5f036982bf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.218450 Sep 06 16:27:13.695075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 538/1114] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:13 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:13.883083 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:13.884043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:13.891334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:13.891850 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:13.892317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:13.893111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:13.896511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:13.897241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:13.950004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:13.950381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:13.950853 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:13.951310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:14.015427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:14.029343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0cb1b31f-b2ef-4a7c-94e4-883651029626 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.152995 Sep 06 16:27:14.030733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 577/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:13 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:14.128666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:14.129547 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:14.137620 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:14.138141 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:14.138578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:14.139416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:14.139869 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:14.140418 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:14.181991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-578decbd-15c2-452c-8fda-1480c0e932be tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/ips" status: 200 len: 149 microversion: 2.1 time: 0.060271 Sep 06 16:27:14.184164 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 539/1116] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:27:14 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/ips => generated 149 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:14.666096 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:14.667065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:14.676719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:14.679619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:14.679619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:14.679619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:14.679619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:14.687303 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:14.723017 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:14.723683 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:14.732299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:14.733197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:14.733951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:14.735219 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:14.735993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:14.736675 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:14.869266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:14.880095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7a48e84e-de11-41d8-a5f1-40cf97d286eb tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.222095 Sep 06 16:27:14.880716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 578/1117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:14 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:14.922005 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:14.933199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:14.934968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:14.936309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-efacbdba-03ec-4957-a907-dd708e043634 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.217581 Sep 06 16:27:14.937131 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 540/1118] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:14 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:15.054771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:15.055370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:15.061796 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.062409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.063055 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.063815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.064494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.064996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.103387 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.104064 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.104572 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.105115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:15.149353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:15.157377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2377cee2-ddd0-4d62-a06e-ebb0f6f81ec1 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.107757 Sep 06 16:27:15.157947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 579/1119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:15 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:15.645550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "948b0185-bc33-4784-9abe-c176ab3c3ac3"}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:15.648778 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:15.651748 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:15.658601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.659143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.659590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.660480 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.660948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.661443 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.798393 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=8 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:15.904425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:15.906367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:15.913677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.914309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.914878 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:15.915691 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:15.916235 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:15.916814 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.073582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:16.089334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a873ee33-8a67-4f1a-b4fc-eee84f052952 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.185984 Sep 06 16:27:16.104029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 580/1120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:15 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:16.111529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:16.112191 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:16.118789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.119280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.119722 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.120427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.120885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.121313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.279956 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:16.301144 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:16.304465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:16.306902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-174f97cb-e343-4a26-bd5a-8b116aa57130 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.201099 Sep 06 16:27:16.307946 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 581/1121] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:16 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:16.316845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:16.318112 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:16.330892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.332770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.334493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.335420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.336041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.336519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.375464 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:16.375959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:16.376410 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:16.376862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:16.421084 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:16.429662 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c78451d4-a6fb-4329-9f99-e6eea7364491 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.120189 Sep 06 16:27:16.430257 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 582/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:16 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:17.117217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:17.117956 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:17.124885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:17.125390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:17.125834 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:17.126560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:17.127142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:17.127575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:17.283207 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:17.292765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cae76640-3130-4b2e-af13-4beddf2dfeb2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.180176 Sep 06 16:27:17.301780 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 583/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:17 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:17.335488 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:17.336212 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:17.344349 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:17.344958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:17.345504 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:17.346315 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:17.347370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:17.347834 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:17.539996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:17.551135 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:17.554736 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:17.557105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b84958fe-cce1-48cb-a82e-8915b3106b34 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.226733 Sep 06 16:27:17.558393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 584/1124] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:17 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:17.564106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:17.564416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:17.572051 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:17.572635 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:17.573153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:17.573895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:17.574401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:17.574875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:17.635844 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:17.636484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:17.636973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:17.637433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:17.693280 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:17.701376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c9fb2efd-9999-4390-acf9-33fce7b84df5 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.141670 Sep 06 16:27:17.702217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 585/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:17 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:18.319396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:18.320406 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:18.328528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.329147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.329919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.330773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.331479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.332208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.499147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:18.507735 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-90808c4d-907c-4700-ad3d-a43ffccacc7e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.194065 Sep 06 16:27:18.508310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 586/1126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:18 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:18.601180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:18.601800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:18.608337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.609002 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.609484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.610185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.610650 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.611093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.769433 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:18.780379 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:18.781840 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:18.783065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a8d9b36-6432-463b-8488-efd6227670d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.186291 Sep 06 16:27:18.783836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 587/1127] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:18 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:18.789141 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:18.789763 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:18.799536 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.802874 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.803461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.804325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.804934 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.805496 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.864602 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:18.865023 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:18.865461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:18.865947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:18.867945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:18.912770 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:18.921109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1da9da04-3a5c-456e-94b5-9acc70fde3d9 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.136435 Sep 06 16:27:18.921688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 588/1128] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:18 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:19.531324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:19.532001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:19.539616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.540142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:19.540611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:19.541353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.541801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:19.542277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:19.694052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:19.700881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-354e8919-97fb-428b-b1d3-a4f248c661d6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.173536 Sep 06 16:27:19.701469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 589/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:19 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:19.809644 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:19.810333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:19.816987 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.817584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:19.817911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:19.818622 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.819330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:19.819518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:19.973475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:19.982562 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:19.984049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:19.985232 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-30568ba8-2db6-4888-8d52-afa2243f9a7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.179627 Sep 06 16:27:19.985793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 590/1130] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:19 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:19.991061 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:19.991682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:19.997656 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.998087 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:19.998532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:19.999263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:19.999718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.000146 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.035890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.039091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.039091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.039091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:20.080976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:20.089045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-40aa6aa6-4543-4113-a6a2-6f892223f752 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.102248 Sep 06 16:27:20.089623 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 591/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:19 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:20.724361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:20.725019 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:20.731689 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.732193 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.732661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.733362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:20.733815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:20.734242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:20.882716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:20.891528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-62ac2720-6706-4580-b94e-44c6b3dc9a61 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.171243 Sep 06 16:27:20.892118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 592/1132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:20 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:21.014632 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:21.015206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:21.021540 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.022093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.022577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.023330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.023789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.024309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.180158 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:21.189185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:21.190996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:21.192228 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ee5aa34f-4d6c-4b23-905c-abc6d9dbd3a9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.182001 Sep 06 16:27:21.192800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 593/1133] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:21 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:21.197248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:21.197856 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:21.204145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.204656 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.205099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.205794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.206764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.207196 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.241050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.241566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.241991 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.242450 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:21.290101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:21.299744 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cf9e0e39-d368-46fa-9646-08c1b83af5a2 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.105888 Sep 06 16:27:21.300557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 594/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:21 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:21.914220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:21.914910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:21.921390 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.921881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.922530 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:21.923434 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:21.923896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:21.924325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.074557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:22.084268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d351709-d7ee-4b05-a30b-453704483dc3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.174137 Sep 06 16:27:22.084851 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 595/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:21 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:22.217801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:22.218411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:22.225047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:22.225543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:22.225983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.226728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:22.227185 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:22.227615 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.372333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:22.382525 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:22.384000 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:22.385174 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-72aaba37-aa37-4480-94c5-d5e0e102f93f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.171393 Sep 06 16:27:22.385733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 596/1136] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:22 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:22.390147 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:22.390773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:22.397108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:22.397686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:22.398125 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.398857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:22.399307 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:22.399731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.446051 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:22.446422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:22.446959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:22.447412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:22.492870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:22.501255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7604be22-4cef-4ca2-aa9e-6f4280598a8e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.114496 Sep 06 16:27:22.501845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 597/1137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:22 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:23.107544 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:23.108340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:23.117062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.117565 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.118017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.118805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.119270 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.119737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.270984 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:23.278739 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-756c2eac-77ea-44f2-a02c-f5c865336e47 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.174992 Sep 06 16:27:23.279314 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 598/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:23 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:23.412268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:23.412799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:23.418960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.419443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.419882 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.420586 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.421034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.421463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.578534 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:23.590310 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:23.591820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:23.593480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eabe5fb2-2d75-4a4d-8a2c-099f7da003e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.185885 Sep 06 16:27:23.606331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 599/1139] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:23 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:23.606331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:23.606331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:23.619268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.619870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.620395 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.621164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.621620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.622045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.660138 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:23.660961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:23.661084 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:23.661646 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:23.716074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:23.724492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-97f33254-2387-4064-b4d8-ff67f4052a48 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.129415 Sep 06 16:27:23.725108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 600/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:23 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:24.303429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:24.304110 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:24.310503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.311026 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.311462 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.312161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.312610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.313033 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.455267 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:24.464338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9d89ca2c-f7d8-4ba3-b9f3-ddd0a7db6a82 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.165660 Sep 06 16:27:24.478692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 601/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:24 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:24.620267 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:24.620885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:24.626923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.627415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.627935 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.628839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.629304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.629730 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.770527 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:24.779638 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:24.781093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:24.782267 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-49d0b1f3-13de-45f4-b2d9-1b7eb4432d7e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.166096 Sep 06 16:27:24.782858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 602/1142] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:24 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:24.787257 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e0c5906d-34ca-4538-b163-70b850d2185a req-3e5da481-97a1-462a-bf75-69d084feb175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4e8266-0821-4d32-98eb-be879841b7c2", "tag": "6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:24.797599 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e0c5906d-34ca-4538-b163-70b850d2185a req-3e5da481-97a1-462a-bf75-69d084feb175 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.798079 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e0c5906d-34ca-4538-b163-70b850d2185a req-3e5da481-97a1-462a-bf75-69d084feb175 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.798512 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e0c5906d-34ca-4538-b163-70b850d2185a req-3e5da481-97a1-462a-bf75-69d084feb175 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.809702 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-e0c5906d-34ca-4538-b163-70b850d2185a req-3e5da481-97a1-462a-bf75-69d084feb175 service nova] Creating event network-changed:6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3 for instance 6e4e8266-0821-4d32-98eb-be879841b7c2 on hv-cinder-85220 Sep 06 16:27:24.814568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e0c5906d-34ca-4538-b163-70b850d2185a req-3e5da481-97a1-462a-bf75-69d084feb175 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030620 Sep 06 16:27:24.815199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 603/1143] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:24.820783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:24.821521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:24.828726 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.829199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.829641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.830348 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.830836 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.831336 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.857881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:24.884780 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:24.885253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:24.885714 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:24.886159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lazy-loading 'fault' on Instance uuid 38cb0205-745c-4ec5-8e7f-be4abd758c3d {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:24.929896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72cc5f5b1b6b4fb28d57c7ff7931fdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b52ac4a27fe84303970a9f7e104c5298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:24.937618 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-17742d16-6b41-4141-b850-b2cfb2cbf2c6 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 200 len: 1325 microversion: 2.1 time: 0.120818 Sep 06 16:27:24.938180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 604/1144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:24 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 1325 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:25.487539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:25.488200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:25.495036 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.495558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.496066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.496957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.497236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.497874 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.516107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f3d9d364-cdc0-42b6-bcf5-8a0760f20de2 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "POST /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.876796 Sep 06 16:27:25.517157 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 541/1145] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 6 16:27:15 2022] POST /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments => generated 194 bytes in 9879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:25.667327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:25.675681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d6256be1-8d58-4f00-ba5c-509ef492f1b7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.191719 Sep 06 16:27:25.676281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 605/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:25 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:25.809930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:25.810704 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:25.813176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=15 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:25.819479 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.819993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.820426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.821126 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.821576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.821999 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.961954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:25.962478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:25.968789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.969275 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.969705 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.970411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:25.970887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:25.971319 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:25.986324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] HTTP exception thrown: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Request method failure captured: Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d HTTP/1.1 Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Jel1NYp-w3Ncno-9EGtyIn9Y_i4sRz8CvZhUAo5uX1u21ZYELiVXea7FBVyTSwIvxIvqMalIT6XDeMkHLxcwFiDq53w1Kl7d7XkvZ5McoEEq3mPqjn_4J2WQUBAa9eAXycFc85rlXSX4ZQ_SwALghTP5wvkK2jBgjmOK__uX80zWY Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:25.988906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 72cc5f5b1b6b4fb28d57c7ff7931fdff Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:25.990962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '38cb0205-745c-4ec5-8e7f-be4abd758c3d'} Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:25.991885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:25.993483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:25.994846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Returning 404 to user: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:25.994846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-65df7dbd-3fb4-4188-9dbf-71a8196eeb07 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 404 len: 111 microversion: 2.1 time: 0.032472 Sep 06 16:27:25.994846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 606/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:25 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:27:25.999685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6c31ec82-18db-4803-b8d7-d14c756d753e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '.version_select at 0x7f21b80e9a60>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:26.021942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6c31ec82-18db-4803-b8d7-d14c756d753e tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-629378530" status: 202 len: 0 microversion: 2.1 time: 0.026031 Sep 06 16:27:26.022577 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 607/1148] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Sep 6 16:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-629378530 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:27:26.322618 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:26.332939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:26.334690 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:26.335961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0db94769-576b-4f92-a5cc-97c73f66c4c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.530444 Sep 06 16:27:26.336764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 542/1149] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:25 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:26.710088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:26.710859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:26.720431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:26.721026 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:26.721715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:26.723041 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:26.723607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:26.724114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:26.874000 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:26.883153 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-465b7de9-abc9-4c11-adcd-39041810473e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.177728 Sep 06 16:27:26.883743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 608/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:26 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:27.367622 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:27.368936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:27.377642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:27.378267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:27.378834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:27.379654 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:27.380114 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:27.380545 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:27.403797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:27.521551 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:27.530451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:27.531948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:27.533135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fba5c5de-9bdc-4e46-a1c2-aa83faeb4cbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.173746 Sep 06 16:27:27.533700 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 543/1151] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:27 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:27.906694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:27.907439 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:27.918256 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:27.918865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:27.919345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:27.920086 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:27.920537 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:27.920957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.070109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:28.078068 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-51c2f1fc-795f-45e8-b0dd-b3e0ed4b3bb7 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.175356 Sep 06 16:27:28.078623 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 609/1152] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:27 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:28.559937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:28.560467 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:28.567499 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.567994 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.568434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.569138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:28.569594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:28.570025 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:28.709235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:28.718602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:28.720088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:28.721309 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-495341a0-edf7-42a6-8186-58cdff1086bc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.165528 Sep 06 16:27:28.721944 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 544/1153] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:28 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:29.024441 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:29.024968 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:29.032481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.033001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.033443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.034149 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.034603 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.035074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.050771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] HTTP exception thrown: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Request method failure captured: Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d HTTP/1.1 Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Jel1NYp-w3Ncno-9EGtyIn9Y_i4sRz8CvZhUAo5uX1u21ZYELiVXea7FBVyTSwIvxIvqMalIT6XDeMkHLxcwFiDq53w1Kl7d7XkvZ5McoEEq3mPqjn_4J2WQUBAa9eAXycFc85rlXSX4ZQ_SwALghTP5wvkK2jBgjmOK__uX80zWY Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:29.053078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 72cc5f5b1b6b4fb28d57c7ff7931fdff Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.055411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '38cb0205-745c-4ec5-8e7f-be4abd758c3d'} Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:29.056978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.059188 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.061438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Returning 404 to user: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:29.061438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2a24bd61-4dd3-498f-b979-15b536ca4604 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 404 len: 111 microversion: 2.1 time: 0.034639 Sep 06 16:27:29.061438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 610/1154] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:29 2022] DELETE /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:29.063218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:29.063828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 38cb0205-745c-4ec5-8e7f-be4abd758c3d] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:29.070464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.070995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.071441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.072220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.072702 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.073079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.087581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] HTTP exception thrown: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Request method failure captured: Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d HTTP/1.1 Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Jel1NYp-w3Ncno-9EGtyIn9Y_i4sRz8CvZhUAo5uX1u21ZYELiVXea7FBVyTSwIvxIvqMalIT6XDeMkHLxcwFiDq53w1Kl7d7XkvZ5McoEEq3mPqjn_4J2WQUBAa9eAXycFc85rlXSX4ZQ_SwALghTP5wvkK2jBgjmOK__uX80zWY Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:29.089282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 72cc5f5b1b6b4fb28d57c7ff7931fdff Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.090950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '38cb0205-745c-4ec5-8e7f-be4abd758c3d'} Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:29.092007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. Sep 06 16:27:29.093487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:29.094981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Returning 404 to user: Instance 38cb0205-745c-4ec5-8e7f-be4abd758c3d could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:29.094981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4d432270-c4d7-4180-8d55-522e985b51e3 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d" status: 404 len: 111 microversion: 2.1 time: 0.031334 Sep 06 16:27:29.094981 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 545/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:29 2022] GET /compute/v2.1/servers/38cb0205-745c-4ec5-8e7f-be4abd758c3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:27:29.102074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:29.102801 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:29.111633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.112127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.112571 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.113329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.114377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.115169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.259422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:29.267613 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c0fd5652-5874-435c-83cb-032c063efbe0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.170155 Sep 06 16:27:29.268182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 611/1156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:29 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:29.748254 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:29.748968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:29.756964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.757453 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.757890 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.758734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:29.759088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:29.759516 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:29.943351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:29.954416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:29.955898 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:29.957072 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b8986d28-928e-4646-967e-d1ec32a06929 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.212864 Sep 06 16:27:29.957674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 546/1157] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:29 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:30.246938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:30.247497 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:30.254038 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.254764 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.255214 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.255923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.256400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.256816 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.271713 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] HTTP exception thrown: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Request method failure captured: Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 HTTP/1.1 Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Jel1NYp-w3Ncno-9EGtyIn9Y_i4sRz8CvZhUAo5uX1u21ZYELiVXea7FBVyTSwIvxIvqMalIT6XDeMkHLxcwFiDq53w1Kl7d7XkvZ5McoEEq3mPqjn_4J2WQUBAa9eAXycFc85rlXSX4ZQ_SwALghTP5wvkK2jBgjmOK__uX80zWY Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:30.273304 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 72cc5f5b1b6b4fb28d57c7ff7931fdff Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.275099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '1d89aa26-192e-4016-93ea-772996bb9e49'} Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:30.276003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.277903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.279610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Returning 404 to user: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:30.279610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-23a2be30-7f9c-4537-b1b5-77b42bf36734 tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 404 len: 111 microversion: 2.1 time: 0.031693 Sep 06 16:27:30.279610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 612/1158] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:30 2022] DELETE /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 16:27:30.287574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:30.288598 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] [instance: 1d89aa26-192e-4016-93ea-772996bb9e49] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:30.290794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:30.291426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:30.298062 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.298589 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.299074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.299982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.300560 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.300866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.312295 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.313049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.313798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.314961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.315496 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.316001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.333166 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] HTTP exception thrown: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Request method failure captured: Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 HTTP/1.1 Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Jel1NYp-w3Ncno-9EGtyIn9Y_i4sRz8CvZhUAo5uX1u21ZYELiVXea7FBVyTSwIvxIvqMalIT6XDeMkHLxcwFiDq53w1Kl7d7XkvZ5McoEEq3mPqjn_4J2WQUBAa9eAXycFc85rlXSX4ZQ_SwALghTP5wvkK2jBgjmOK__uX80zWY Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:30.335133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b52ac4a27fe84303970a9f7e104c5298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: b52ac4a27fe84303970a9f7e104c5298 Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1159917075 Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 72cc5f5b1b6b4fb28d57c7ff7931fdff Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeTestJSON-1159917075-project Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.337519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '1d89aa26-192e-4016-93ea-772996bb9e49'} Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:30.338556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. Sep 06 16:27:30.341221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:30.342611 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] Returning 404 to user: Instance 1d89aa26-192e-4016-93ea-772996bb9e49 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:30.349333 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a78a6062-6f54-4561-aa44-8c0aed6eae5d tempest-AttachVolumeTestJSON-1159917075 tempest-AttachVolumeTestJSON-1159917075-project] 10.222.0.26 "GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49" status: 404 len: 111 microversion: 2.1 time: 0.055778 Sep 06 16:27:30.350000 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 547/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:30 2022] GET /compute/v2.1/servers/1d89aa26-192e-4016-93ea-772996bb9e49 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:30.464058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:30.473655 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-48976106-f49d-4000-93c6-73c29e3fb5d1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.186096 Sep 06 16:27:30.486883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 613/1160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:30 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:30.983680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:30.984419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:30.992608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.993203 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.993915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:30.994762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:30.995229 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:30.995661 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:31.228217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:31.236931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:31.238608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:31.239735 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1f775c69-504a-49c6-b217-35416fddb699 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.260505 Sep 06 16:27:31.240306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 548/1161] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:30 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:31.499892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:31.500775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:31.503676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:31.509846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:31.511428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:31.512121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:31.512957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:31.513532 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:31.514957 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:31.684273 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:31.694428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a436b311-9281-4200-9136-082ee437c969 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.200814 Sep 06 16:27:31.695045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 614/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:31 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:31.867647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-912c881f-8ee9-4310-960f-6457f7d483c4 req-45500977-6bdd-4844-9309-e281d2236f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4e8266-0821-4d32-98eb-be879841b7c2", "name": "network-vif-plugged", "status": "completed", "tag": "6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:31.878461 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-912c881f-8ee9-4310-960f-6457f7d483c4 req-45500977-6bdd-4844-9309-e281d2236f67 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:31.878986 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-912c881f-8ee9-4310-960f-6457f7d483c4 req-45500977-6bdd-4844-9309-e281d2236f67 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:31.880055 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-912c881f-8ee9-4310-960f-6457f7d483c4 req-45500977-6bdd-4844-9309-e281d2236f67 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:31.895188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-912c881f-8ee9-4310-960f-6457f7d483c4 req-45500977-6bdd-4844-9309-e281d2236f67 service nova] Creating event network-vif-plugged:6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3 for instance 6e4e8266-0821-4d32-98eb-be879841b7c2 on hv-cinder-85220 Sep 06 16:27:31.901095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-912c881f-8ee9-4310-960f-6457f7d483c4 req-45500977-6bdd-4844-9309-e281d2236f67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038713 Sep 06 16:27:31.902079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 549/1163] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:32.275824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:32.276447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:32.282628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:32.283173 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:32.283606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:32.284326 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:32.284772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:32.285190 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:32.509420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:32.519234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:32.520752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:32.521971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-35ff1411-5cf4-451c-a3ee-124dd3f72c6e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.260479 Sep 06 16:27:32.522529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 615/1164] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:32 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:32.719505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:32.720212 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:32.726764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:32.727298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:32.727687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:32.728390 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:32.728849 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:32.729280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:32.874256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:32.884054 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9c7819e8-4ae0-45e7-b82a-16298c751d01 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.169248 Sep 06 16:27:32.884571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 550/1165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:32 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:33.548276 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:33.548926 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:33.557231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:33.557727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:33.558168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:33.558902 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:33.563142 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:33.565145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:33.791917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:33.802234 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:33.804688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:33.806093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e26248cc-8ca1-4e83-b342-685be52fd847 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.262081 Sep 06 16:27:33.806934 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 616/1166] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:33 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:33.917191 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:33.917829 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:33.940670 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:33.941169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:33.941711 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:33.942554 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:33.943071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:33.943504 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.253802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:34.266970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-755cc90b-319e-4b81-9131-5384af8bcb35 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.361404 Sep 06 16:27:34.288836 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 551/1167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:33 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:34.465131 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:34.465740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:34.472289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.473470 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.473914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.474632 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.475129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.475587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.571564 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lazy-loading 'services' on Instance uuid 49e96833-c75c-4637-8c58-21bf3949a7f8 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:27:34.657145 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0a459e23-ce05-479b-a8f1-60f1375d5115 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments/948b0185-bc33-4784-9abe-c176ab3c3ac3" status: 202 len: 0 microversion: 2.1 time: 0.195880 Sep 06 16:27:34.657882 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 617/1168] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 6 16:27:34 2022] DELETE /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments/948b0185-bc33-4784-9abe-c176ab3c3ac3 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 16:27:34.667737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:34.670245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:34.677476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.678016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.678468 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.680016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.680457 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.680973 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.718026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0b5e6983-117b-4a34-b9be-9193cfac99d6 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054290 Sep 06 16:27:34.723819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 552/1169] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:34 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:34.835396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:34.836118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:34.842369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.842889 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.843321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:34.844022 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:34.844547 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:34.845156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.002908 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:35.012423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:35.014054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:35.015403 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c1f0da5c-e721-4362-9116-51a9c957d54e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.185483 Sep 06 16:27:35.016058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 618/1170] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:34 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:27:35.291903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:35.292543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:35.299670 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:35.300175 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:35.300616 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.301394 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:35.302043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:35.302485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.451083 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:35.463075 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-00f7f282-2410-4c3f-a94f-25f7d0ba62b8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1266 microversion: 2.1 time: 0.175005 Sep 06 16:27:35.463669 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 553/1171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:35 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:35.481240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4d4199f9-c11b-4a30-9486-9d7e15a9ae24 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Action: 'create', calling method: .version_select at 0x7f21b804eb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465488288", "metadata": {"Type": "work"}}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4d4199f9-c11b-4a30-9486-9d7e15a9ae24 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Request method failure captured: Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 121 Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3T3kuSbFvk3hRiFEBovhqRZDjkic3P3HWHN25r-HAHoNM6RGibh80QftuCh1Uwy__ffksqFZ2PCoCzidb5Q7xxdm41GvfFl88FqtUVxV37FPx1VEq9nqWpbbNAwzvCAp0ksQj31FGxiuPtvoEevpUdXm3buiJByl3oiYhdcpnXqKKs Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:35.491980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 7ea2c080dd9f4e149d3041042a39ce66 Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465488288", "metadata": {"Type": "work"}}} Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: Sep 06 16:27:35.495034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-465488288', 'metadata': {'Type': 'work'}}}} Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise error Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:35.495919 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 16:27:35.497815 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 16:27:35.499423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 16:27:35.499423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.499423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4d4199f9-c11b-4a30-9486-9d7e15a9ae24 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:35.499423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4d4199f9-c11b-4a30-9486-9d7e15a9ae24 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147663 Sep 06 16:27:35.499423 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 619/1172] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Sep 6 16:27:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 16:27:35.507935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-68ce5ac7-a2bb-407e-8303-5449d0cf5b94 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Action: 'create', calling method: .version_select at 0x7f21b84ea670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1950806299", "metadata": {"Type": "work"}}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-68ce5ac7-a2bb-407e-8303-5449d0cf5b94 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Request method failure captured: Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 120 Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3T3kuSbFvk3hRiFEBovhqRZDjkic3P3HWHN25r-HAHoNM6RGibh80QftuCh1Uwy__ffksqFZ2PCoCzidb5Q7xxdm41GvfFl88FqtUVxV37FPx1VEq9nqWpbbNAwzvCAp0ksQj31FGxiuPtvoEevpUdXm3buiJByl3oiYhdcpnXqKKs Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:35.514110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 7ea2c080dd9f4e149d3041042a39ce66 Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1950806299", "metadata": {"Type": "work"}}} Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: Sep 06 16:27:35.515751 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1950806299', 'metadata': {'Type': 'work'}}}} Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise error Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi '0' Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:35.516752 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 16:27:35.518523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 16:27:35.520507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 16:27:35.520507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.520507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-68ce5ac7-a2bb-407e-8303-5449d0cf5b94 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:35.520507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-68ce5ac7-a2bb-407e-8303-5449d0cf5b94 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014851 Sep 06 16:27:35.520507 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 554/1173] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Sep 6 16:27:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:27:35.526633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a9dc80b-fe18-443d-bfec-35a2d1189a92 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Action: 'create', calling method: .version_select at 0x7f21b83f9550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1766882638", "metadata": {"Type": "work"}}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a9dc80b-fe18-443d-bfec-35a2d1189a92 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Request method failure captured: Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 119 Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3T3kuSbFvk3hRiFEBovhqRZDjkic3P3HWHN25r-HAHoNM6RGibh80QftuCh1Uwy__ffksqFZ2PCoCzidb5Q7xxdm41GvfFl88FqtUVxV37FPx1VEq9nqWpbbNAwzvCAp0ksQj31FGxiuPtvoEevpUdXm3buiJByl3oiYhdcpnXqKKs Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:35.530287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 7ea2c080dd9f4e149d3041042a39ce66 Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1766882638", "metadata": {"Type": "work"}}} Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: Sep 06 16:27:35.532027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1766882638', 'metadata': {'Type': 'work'}}}} Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise error Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi '' Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:35.532875 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 16:27:35.534295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 16:27:35.536757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 16:27:35.536757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.536757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a9dc80b-fe18-443d-bfec-35a2d1189a92 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:35.536757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a9dc80b-fe18-443d-bfec-35a2d1189a92 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009097 Sep 06 16:27:35.536757 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 620/1174] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Sep 6 16:27:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:27:35.542561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-70b62aa1-d3b1-4673-b792-2742b6a37080 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Calling method '.version_select at 0x7f21b8187d30>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:35.572970 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-70b62aa1-d3b1-4673-b792-2742b6a37080 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] HTTP exception thrown: Volume tempest-invalid-783700574 could not be found. Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-70b62aa1-d3b1-4673-b792-2742b6a37080 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Request method failure captured: Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-783700574 HTTP/1.1 Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3T3kuSbFvk3hRiFEBovhqRZDjkic3P3HWHN25r-HAHoNM6RGibh80QftuCh1Uwy__ffksqFZ2PCoCzidb5Q7xxdm41GvfFl88FqtUVxV37FPx1VEq9nqWpbbNAwzvCAp0ksQj31FGxiuPtvoEevpUdXm3buiJByl3oiYhdcpnXqKKs Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:35.574998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 7ea2c080dd9f4e149d3041042a39ce66 Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Volume tempest-invalid-783700574 could not be found. Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': 'tempest-invalid-783700574'} Sep 06 16:27:35.576574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-783700574 could not be found. (HTTP 404) (Request-ID: req-2eafbf47-9576-4e11-a283-9224b11a502a) Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.577846 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:27:35.579311 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-783700574 could not be found. Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:35.581160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-783700574 could not be found. Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-783700574 could not be found. Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-70b62aa1-d3b1-4673-b792-2742b6a37080 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Returning 404 to user: Volume tempest-invalid-783700574 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-70b62aa1-d3b1-4673-b792-2742b6a37080 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-783700574" status: 404 len: 98 microversion: 2.1 time: 0.038226 Sep 06 16:27:35.583101 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 555/1175] 10.222.0.26 () {58 vars in 1215 bytes} [Tue Sep 6 16:27:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-783700574 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 16:27:35.592483 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-39a361a3-80cd-4613-a639-f5ec3b4219d6 tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005518 Sep 06 16:27:35.593215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 621/1176] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Sep 6 16:27:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 16:27:35.604097 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a712acff-5194-48e3-b997-790f33f4b5eb tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003892 Sep 06 16:27:35.604515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 556/1177] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Sep 6 16:27:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 16:27:35.613931 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e1fa61dd-76dc-4087-a59e-12cbed9a593e tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Calling method '.version_select at 0x7f21b83f9f70>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:35.650107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-e1fa61dd-76dc-4087-a59e-12cbed9a593e tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] HTTP exception thrown: Volume 3a4fc190-4b90-4d5f-9db4-41930fa2defe could not be found. Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e1fa61dd-76dc-4087-a59e-12cbed9a593e tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Request method failure captured: Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/os-volumes/3a4fc190-4b90-4d5f-9db4-41930fa2defe HTTP/1.1 Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3T3kuSbFvk3hRiFEBovhqRZDjkic3P3HWHN25r-HAHoNM6RGibh80QftuCh1Uwy__ffksqFZ2PCoCzidb5Q7xxdm41GvfFl88FqtUVxV37FPx1VEq9nqWpbbNAwzvCAp0ksQj31FGxiuPtvoEevpUdXm3buiJByl3oiYhdcpnXqKKs Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:35.652415 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 7ea2c080dd9f4e149d3041042a39ce66 Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Volume 3a4fc190-4b90-4d5f-9db4-41930fa2defe could not be found. Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '3a4fc190-4b90-4d5f-9db4-41930fa2defe'} Sep 06 16:27:35.654092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a4fc190-4b90-4d5f-9db4-41930fa2defe could not be found. (HTTP 404) (Request-ID: req-44f00a8d-b40a-4776-a116-fbe4c994320c) Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.655117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 16:27:35.656398 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a4fc190-4b90-4d5f-9db4-41930fa2defe could not be found. Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 16:27:35.657760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a4fc190-4b90-4d5f-9db4-41930fa2defe could not be found. Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a4fc190-4b90-4d5f-9db4-41930fa2defe could not be found. Sep 06 16:27:35.659291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.662149 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e1fa61dd-76dc-4087-a59e-12cbed9a593e tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Returning 404 to user: Volume 3a4fc190-4b90-4d5f-9db4-41930fa2defe could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:35.663133 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e1fa61dd-76dc-4087-a59e-12cbed9a593e tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/3a4fc190-4b90-4d5f-9db4-41930fa2defe" status: 404 len: 109 microversion: 2.1 time: 0.053008 Sep 06 16:27:35.663709 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 622/1178] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 6 16:27:35 2022] DELETE /compute/v2.1/os-volumes/3a4fc190-4b90-4d5f-9db4-41930fa2defe => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:35.675829 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-708dccf5-d64e-427d-92f0-e5d06242234a tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Calling method '.version_select at 0x7f21b8138160>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:35.710574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-708dccf5-d64e-427d-92f0-e5d06242234a tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] HTTP exception thrown: Volume ba638843-87bf-45d8-b708-3365b663c066 could not be found. Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-708dccf5-d64e-427d-92f0-e5d06242234a tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Request method failure captured: Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/os-volumes/ba638843-87bf-45d8-b708-3365b663c066 HTTP/1.1 Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3T3kuSbFvk3hRiFEBovhqRZDjkic3P3HWHN25r-HAHoNM6RGibh80QftuCh1Uwy__ffksqFZ2PCoCzidb5Q7xxdm41GvfFl88FqtUVxV37FPx1VEq9nqWpbbNAwzvCAp0ksQj31FGxiuPtvoEevpUdXm3buiJByl3oiYhdcpnXqKKs Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:35.712571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e1d0638bd2d4078b8409acbe1e4335c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 9e1d0638bd2d4078b8409acbe1e4335c Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-VolumesNegativeTest-968929164 Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 7ea2c080dd9f4e149d3041042a39ce66 Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-VolumesNegativeTest-968929164-project Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Volume ba638843-87bf-45d8-b708-3365b663c066 could not be found. Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': 'ba638843-87bf-45d8-b708-3365b663c066'} Sep 06 16:27:35.714350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba638843-87bf-45d8-b708-3365b663c066 could not be found. (HTTP 404) (Request-ID: req-6abbdbd5-7d0f-47b3-89fe-9020c26b2d92) Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.715247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 16:27:35.716416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba638843-87bf-45d8-b708-3365b663c066 could not be found. Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 16:27:35.717570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba638843-87bf-45d8-b708-3365b663c066 could not be found. Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba638843-87bf-45d8-b708-3365b663c066 could not be found. Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-708dccf5-d64e-427d-92f0-e5d06242234a tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] Returning 404 to user: Volume ba638843-87bf-45d8-b708-3365b663c066 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-708dccf5-d64e-427d-92f0-e5d06242234a tempest-VolumesNegativeTest-968929164 tempest-VolumesNegativeTest-968929164-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ba638843-87bf-45d8-b708-3365b663c066" status: 404 len: 109 microversion: 2.1 time: 0.042999 Sep 06 16:27:35.718904 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 557/1179] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 6 16:27:35 2022] GET /compute/v2.1/os-volumes/ba638843-87bf-45d8-b708-3365b663c066 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:35.730781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:35.736622 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:35.741411 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:35.741909 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:35.742352 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.743092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:35.743553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:35.743983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.774298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0e33b264-88b0-4a62-a592-e94593274295 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047971 Sep 06 16:27:35.774918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 623/1180] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:35 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:35.965886 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-961f9e13-2329-47c0-bbf1-6c0e6db51f3e req-234507fe-5ad1-4444-8ebe-c331d7ef318b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2891ad36-504d-4c32-a783-6d93e3a4b43b", "name": "network-vif-plugged", "status": "completed", "tag": "a96c2f08-a914-47c2-b41e-30eb8c3f0faa"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:35.977085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-961f9e13-2329-47c0-bbf1-6c0e6db51f3e req-234507fe-5ad1-4444-8ebe-c331d7ef318b service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:35.977578 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-961f9e13-2329-47c0-bbf1-6c0e6db51f3e req-234507fe-5ad1-4444-8ebe-c331d7ef318b service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:35.978596 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-961f9e13-2329-47c0-bbf1-6c0e6db51f3e req-234507fe-5ad1-4444-8ebe-c331d7ef318b service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:35.990511 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-961f9e13-2329-47c0-bbf1-6c0e6db51f3e req-234507fe-5ad1-4444-8ebe-c331d7ef318b service nova] Creating event network-vif-plugged:a96c2f08-a914-47c2-b41e-30eb8c3f0faa for instance 2891ad36-504d-4c32-a783-6d93e3a4b43b on hv-cinder-85220 Sep 06 16:27:35.995759 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-961f9e13-2329-47c0-bbf1-6c0e6db51f3e req-234507fe-5ad1-4444-8ebe-c331d7ef318b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Sep 06 16:27:35.996352 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 558/1181] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:36.042446 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:36.043215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:36.052553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.053154 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.053788 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.054588 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.055268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.055785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.237584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:36.250121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:36.251823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:36.253459 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a1d0d45-dc44-4820-b1eb-d6baacdb987d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.215003 Sep 06 16:27:36.254676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 624/1182] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:36 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:36.488522 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:36.489735 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:36.496001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.496492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.497047 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.497847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.498373 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.498755 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.673856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:36.682128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-28331136-35da-496c-b3b8-b0cacc035517 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1454 microversion: 2.1 time: 0.198381 Sep 06 16:27:36.682839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 559/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:36 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:36.708428 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:36.709210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:36.719717 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.720107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.720559 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.721279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.721734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.722162 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.787560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:36.789732 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:36.810919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.810919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.810919 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.811613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:36.815519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:36.815965 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:36.858106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-cf295459-fa1b-40ed-a401-7158bae3fe3d tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075186 Sep 06 16:27:36.859053 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 560/1184] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:36 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:36.880761 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:36.889215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4b5ccb7a-b573-4e23-b496-e8867f74bcc6 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1454 microversion: 2.1 time: 0.185582 Sep 06 16:27:36.890063 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 625/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:36 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:27:37.281350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:37.282288 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:37.289772 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.291393 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.291913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.292682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.293233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.293726 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.522931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:37.533284 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:37.536429 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:37.537534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-05d6c2e8-0d40-4fe7-ab4e-21bfbdadffb5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.260255 Sep 06 16:27:37.538183 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 561/1186] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:37 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:37.871545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:37.873811 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:37.880820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.881300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.881731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.882427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:37.882904 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:37.883327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:37.919983 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-36338140-e6ee-41fa-a4b0-fcf3c7953f40 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052321 Sep 06 16:27:37.922785 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 626/1187] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 6 16:27:37 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 16:27:37.999880 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:38.000737 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:38.008033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.008861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.009451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.010300 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.011529 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.011703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.043952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:27:38.133961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d7c770cf-d268-4af9-8044-f309197143cf tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 204 len: 0 microversion: 2.1 time: 0.137896 Sep 06 16:27:38.135223 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 562/1188] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:37 2022] DELETE /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:27:38.145465 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:38.147607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:38.155130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.155837 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.156277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.157038 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.157493 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.158242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.163456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:38.335524 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:38.347183 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6f9136af-0535-4b45-8bb4-8ea07c00a82c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1681 microversion: 2.1 time: 0.206741 Sep 06 16:27:38.348974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 627/1189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:38 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:38.565536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:38.567384 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:38.574847 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.575340 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.575780 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.576490 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:38.576944 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:38.577623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:38.845330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:38.859513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:38.861604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:38.863145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-10cf7a7c-f185-40bb-8c88-8b6a0d780548 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.302642 Sep 06 16:27:38.863952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 563/1190] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:38 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:39.373575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:39.374300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:39.388216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:39.397960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:39.398568 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:39.399650 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:39.400355 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:39.401001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:39.413534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-b071e0dd-a8b4-46ce-bfe9-cc3a5f320c2c req-ea98eb2c-1ebd-4efa-9363-7e8062b8518b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4e8266-0821-4d32-98eb-be879841b7c2", "tag": "6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:39.423438 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b071e0dd-a8b4-46ce-bfe9-cc3a5f320c2c req-ea98eb2c-1ebd-4efa-9363-7e8062b8518b service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:39.424197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b071e0dd-a8b4-46ce-bfe9-cc3a5f320c2c req-ea98eb2c-1ebd-4efa-9363-7e8062b8518b service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:39.424950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-b071e0dd-a8b4-46ce-bfe9-cc3a5f320c2c req-ea98eb2c-1ebd-4efa-9363-7e8062b8518b service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:39.440234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-b071e0dd-a8b4-46ce-bfe9-cc3a5f320c2c req-ea98eb2c-1ebd-4efa-9363-7e8062b8518b service nova] Creating event network-changed:6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3 for instance 6e4e8266-0821-4d32-98eb-be879841b7c2 on hv-cinder-85220 Sep 06 16:27:39.448273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-b071e0dd-a8b4-46ce-bfe9-cc3a5f320c2c req-ea98eb2c-1ebd-4efa-9363-7e8062b8518b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038412 Sep 06 16:27:39.449879 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 564/1191] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:39.621914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:39.633228 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dd9a62dc-96c4-4766-8d8e-fcb6a32c76fa tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1681 microversion: 2.1 time: 0.263500 Sep 06 16:27:39.633816 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 628/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:39 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:39.892963 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:39.895426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:39.905868 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:39.906645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:39.907251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:39.908128 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:39.909124 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:39.909794 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.123488 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.131971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:27:40.138934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.140604 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.141975 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0ba61537-0715-4be0-b7e5-83e0dd60fb09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1805 microversion: 2.20 time: 0.256227 Sep 06 16:27:40.142934 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 565/1193] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:39 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1805 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:40.657964 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:40.658640 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:40.665088 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.665964 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.666877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.668694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:40.669367 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:40.670254 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:40.863876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:40.873668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c2cf3512-1f7d-4544-b99a-355fe3e45c69 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1681 microversion: 2.1 time: 0.219507 Sep 06 16:27:40.874721 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 629/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:40 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:41.169178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:41.170800 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:41.180440 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.181528 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.182245 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.183239 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.183956 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.184477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.520814 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.536233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.538228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:41.539464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3193c47d-50e1-4221-98b1-d291a7e62f58 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1792 microversion: 2.20 time: 0.375415 Sep 06 16:27:41.546959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 566/1195] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:27:41 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1792 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:27:41.903588 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:41.904321 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:41.914872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.915373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.915809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:41.927954 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:41.928703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:41.929192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.000287 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-54af1edd-262f-4bf1-91e0-4b1a8aed54b6 req-4c85f420-b588-4eb4-baf8-2268484d8303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e96833-c75c-4637-8c58-21bf3949a7f8", "name": "network-vif-deleted", "tag": "439668dc-55d5-469b-881b-b0a33d7fae1e"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:27:42.040802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95ac6a289fb345d3a98871f5e11f9414', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd306388a489a4b42a98a85e03968dba7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:27:42.045119 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-54af1edd-262f-4bf1-91e0-4b1a8aed54b6 req-4c85f420-b588-4eb4-baf8-2268484d8303 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:42.046004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-54af1edd-262f-4bf1-91e0-4b1a8aed54b6 req-4c85f420-b588-4eb4-baf8-2268484d8303 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:42.047143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-54af1edd-262f-4bf1-91e0-4b1a8aed54b6 req-4c85f420-b588-4eb4-baf8-2268484d8303 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:42.049591 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f545f997-d484-413a-bba3-253aabbabfb9 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 200 len: 1613 microversion: 2.1 time: 0.149892 Sep 06 16:27:42.065385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 630/1196] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:41 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:27:42.087013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-54af1edd-262f-4bf1-91e0-4b1a8aed54b6 req-4c85f420-b588-4eb4-baf8-2268484d8303 service nova] Creating event network-vif-deleted:439668dc-55d5-469b-881b-b0a33d7fae1e for instance 49e96833-c75c-4637-8c58-21bf3949a7f8 on hv-cinder-85220 Sep 06 16:27:42.096477 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-54af1edd-262f-4bf1-91e0-4b1a8aed54b6 req-4c85f420-b588-4eb4-baf8-2268484d8303 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110630 Sep 06 16:27:42.098572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 567/1197] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:27:43.073584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:43.074413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:43.082873 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:43.083810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:43.083810 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:43.084538 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:43.084997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:43.085424 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:43.103497 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 HTTP/1.1 Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:43.107629 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:43.110575 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '49e96833-c75c-4637-8c58-21bf3949a7f8'} Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:43.112938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:43.115974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:43.118510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:43.118510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-029e641e-bb3a-4ecd-bdec-5f2238bfa6c4 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 404 len: 111 microversion: 2.1 time: 0.036817 Sep 06 16:27:43.118510 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 631/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:43 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:43.119167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-5c86daa2-ddbb-4c30-9342-a7fbc75206fc tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '.version_select at 0x7f21b84eaee0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:43.140422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-5c86daa2-ddbb-4c30-9342-a7fbc75206fc tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-611491601" status: 202 len: 0 microversion: 2.1 time: 0.027572 Sep 06 16:27:43.141033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 568/1199] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Sep 6 16:27:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-611491601 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 16:27:45.110341 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:45.110341 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:45.112414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.113048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.114641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.115486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.116005 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.116478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.132206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 HTTP/1.1 Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:45.133807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.135523 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '49e96833-c75c-4637-8c58-21bf3949a7f8'} Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:45.136668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.138156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.139749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:45.139749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fc9582da-1967-4c53-93a4-9d832c6dedab tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 404 len: 111 microversion: 2.1 time: 0.039297 Sep 06 16:27:45.139749 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 632/1200] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:45 2022] DELETE /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:45.149317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:45.150917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 49e96833-c75c-4637-8c58-21bf3949a7f8] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:45.158291 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.158823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.159277 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.159985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:45.161230 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:45.161666 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:45.178134 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 HTTP/1.1 Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:45.179917 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.183155 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '49e96833-c75c-4637-8c58-21bf3949a7f8'} Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:45.184267 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. Sep 06 16:27:45.185813 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:45.186989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 49e96833-c75c-4637-8c58-21bf3949a7f8 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:45.186989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-dff02a19-aec8-415f-b9b7-d4fb7c798757 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8" status: 404 len: 111 microversion: 2.1 time: 0.037625 Sep 06 16:27:45.186989 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 569/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:45 2022] GET /compute/v2.1/servers/49e96833-c75c-4637-8c58-21bf3949a7f8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:46.339156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:46.339745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:46.346115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.346600 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.347066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.348399 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.348849 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.349268 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.369426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 HTTP/1.1 Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:46.371025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.372737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35'} Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:46.373732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.375333 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.377244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:46.377244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-adeeb2d2-e5f2-4c7c-a7bf-001921b59c4c tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 404 len: 111 microversion: 2.1 time: 0.037220 Sep 06 16:27:46.377244 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 633/1202] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:46 2022] DELETE /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:46.381480 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:46.382263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:46.389080 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.389553 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.389987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.390709 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.391152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.391573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.405915 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 HTTP/1.1 Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:46.407540 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.409407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35'} Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:46.411092 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. Sep 06 16:27:46.412717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.414600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:46.414600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4b68e2da-1319-4ec2-8b82-a61a95c05433 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35" status: 404 len: 111 microversion: 2.1 time: 0.031557 Sep 06 16:27:46.414600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 570/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:46 2022] GET /compute/v2.1/servers/3ffce32a-8e83-4aa0-bd03-04a3fc5a7a35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:46.424425 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:46.424990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:46.432543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.433044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.433477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.434176 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.434639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.435087 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.449686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 HTTP/1.1 Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:46.451290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.453179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '736a6120-d82c-47e3-9565-163cdcc46d08'} Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:46.454290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.455821 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.458003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:46.458003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1b1af761-2948-43a5-aff3-e7ba3f413fd1 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 404 len: 111 microversion: 2.1 time: 0.036528 Sep 06 16:27:46.458003 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 634/1204] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:46 2022] DELETE /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:46.461828 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:46.462482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 736a6120-d82c-47e3-9565-163cdcc46d08] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:46.469298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.469827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.470381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.471251 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:46.471888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:46.472362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:46.488103 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 HTTP/1.1 Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:46.490923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.492519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '736a6120-d82c-47e3-9565-163cdcc46d08'} Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:46.493455 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. Sep 06 16:27:46.494787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:46.496037 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 736a6120-d82c-47e3-9565-163cdcc46d08 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:46.496037 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fb1363b8-7646-4c63-a342-6fad8067b571 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08" status: 404 len: 111 microversion: 2.1 time: 0.034602 Sep 06 16:27:46.496037 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 571/1205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:46 2022] GET /compute/v2.1/servers/736a6120-d82c-47e3-9565-163cdcc46d08 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:47.657261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:47.657930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:47.666841 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.667426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.667882 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.668887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.669545 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.670290 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.687349 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 HTTP/1.1 Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:27:47.689004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.691092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '75eba83a-9a4e-46fb-854b-17e2f53a0444'} Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:47.692001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.693626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.696378 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:47.696378 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4edc5fc2-98d0-4fe7-a829-fdc18a9e9c41 tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 404 len: 111 microversion: 2.1 time: 0.037509 Sep 06 16:27:47.696378 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 635/1206] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:27:47 2022] DELETE /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:27:47.701894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:27:47.703112 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] [instance: 75eba83a-9a4e-46fb-854b-17e2f53a0444] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:27:47.711984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.711984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.712351 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.713074 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:27:47.713569 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:27:47.713998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:27:47.731537 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] HTTP exception thrown: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Request method failure captured: Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 HTTP/1.1 Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3HhwBryk7Bvx7F4YZXOaNrM5ucB8opm41kQVkq1xeW4w_LQPtiGQ4WD-L907bkN8uJKmxk_50msJBs6LlkUD_HbYk_F_uWuP3av_dst6cBMVFhlMQIy9ePP-FwgW9H3-doyoo7o1fooJlt8kvxvXDuPHv_cQd9tmkDBSO8qS2Ee1FM Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:27:47.733051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d306388a489a4b42a98a85e03968dba7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d306388a489a4b42a98a85e03968dba7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: d306388a489a4b42a98a85e03968dba7 Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-78967009 Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 95ac6a289fb345d3a98871f5e11f9414 Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeNegativeTest-78967009-project Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.735733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '75eba83a-9a4e-46fb-854b-17e2f53a0444'} Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:27:47.736823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. Sep 06 16:27:47.739009 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:27:47.740581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] Returning 404 to user: Instance 75eba83a-9a4e-46fb-854b-17e2f53a0444 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:27:47.740581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-196d60bf-aee3-4d23-8176-f2ebe2f66fff tempest-AttachVolumeNegativeTest-78967009 tempest-AttachVolumeNegativeTest-78967009-project] 10.222.0.26 "GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444" status: 404 len: 111 microversion: 2.1 time: 0.036488 Sep 06 16:27:47.740581 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 572/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:27:47 2022] GET /compute/v2.1/servers/75eba83a-9a4e-46fb-854b-17e2f53a0444 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:28:45.407774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:45.408404 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:45.410713 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=35 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:45.411396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=33 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:45.412241 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:28:45.412412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Tue Sep 6 16:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments/8a3c6039-a767-4ddc-bfa2-ec297cc2c7e0 (ip 10.222.0.26) !!! Sep 06 16:28:45.421456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:45.421965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:45.422430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:45.423221 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:45.423681 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:45.424114 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:45.459918 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-93ea5ea0-e128-4908-9023-f96ba208724b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments/8a3c6039-a767-4ddc-bfa2-ec297cc2c7e0" status: 200 len: 194 microversion: 2.20 time: 0.056266 Sep 06 16:28:45.460530 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 636/1208] 10.222.0.26 () {60 vars in 1454 bytes} [Tue Sep 6 16:28:45 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments/8a3c6039-a767-4ddc-bfa2-ec297cc2c7e0 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:28:45.532733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:45.533285 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:45.536144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:45.536787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=16 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:28:45.544848 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:45.545335 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:45.545771 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:45.546474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:45.546953 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:45.547380 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:45.631024 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lazy-loading 'services' on Instance uuid 2891ad36-504d-4c32-a783-6d93e3a4b43b {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:28:45.710272 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b3b0bc8f-cfda-4da6-9457-4889f7c731bd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments/8a3c6039-a767-4ddc-bfa2-ec297cc2c7e0" status: 202 len: 0 microversion: 2.20 time: 0.181520 Sep 06 16:28:45.710910 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 573/1209] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Sep 6 16:28:45 2022] DELETE /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments/8a3c6039-a767-4ddc-bfa2-ec297cc2c7e0 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:28:45.719743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:45.721982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:45.729073 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:45.729654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:45.730100 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:45.730938 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:45.731400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:45.731876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:45.762958 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-881850ae-a102-4c6f-97b3-6b7a29cc26d5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047450 Sep 06 16:28:45.763767 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 637/1210] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Sep 6 16:28:45 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:28:46.776768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:46.779811 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:46.788827 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:46.789628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:46.790145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:46.790974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:46.791502 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:46.792005 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:46.827242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-652a42a6-95e9-473c-b71e-39b88d94ddb4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054868 Sep 06 16:28:46.827819 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 574/1211] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Sep 6 16:28:46 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:28:46.892209 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:46.892752 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:46.899507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:46.899985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:46.900418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:46.901099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:46.901539 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:46.901953 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:46.927236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:28:47.002843 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d357a37b-0d2e-4135-a0cf-e552a69190c4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 204 len: 0 microversion: 2.20 time: 0.114126 Sep 06 16:28:47.003436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 638/1212] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Sep 6 16:28:46 2022] DELETE /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 16:28:47.012437 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:47.013044 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:47.019550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:47.020058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:47.020489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:47.021172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:47.021617 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:47.022037 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:47.152716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:47.161327 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:47.162871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:47.164041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3d314989-3e0e-4e66-89a0-9324fa116808 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.155499 Sep 06 16:28:47.164601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 575/1213] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:47 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:28:48.190610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:48.191370 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:48.198965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:48.199444 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:48.199879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:48.200562 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:48.201008 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:48.201427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:48.334082 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:48.342182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:48.343666 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:48.344868 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6b85d6d2-9c77-4f76-80c8-d50a08b212f4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.158598 Sep 06 16:28:48.345418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 639/1214] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:48 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:28:49.371201 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:49.371923 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:49.378282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:49.378836 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:49.379602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:49.380081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:49.380576 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:49.380958 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:49.619993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:49.629177 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:49.631032 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:49.632193 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9ca2a795-89d3-4d13-88c5-f7fa32301866 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1720 microversion: 2.20 time: 0.264922 Sep 06 16:28:49.632746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 576/1215] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:49 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1720 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:28:50.107318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-34459e16-91e2-476f-8ea7-41ffc0ee69e8 req-e755cb41-558e-4b25-8eb9-129aca683450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2891ad36-504d-4c32-a783-6d93e3a4b43b", "name": "network-vif-deleted", "tag": "a96c2f08-a914-47c2-b41e-30eb8c3f0faa"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:50.119443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-34459e16-91e2-476f-8ea7-41ffc0ee69e8 req-e755cb41-558e-4b25-8eb9-129aca683450 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:50.119928 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-34459e16-91e2-476f-8ea7-41ffc0ee69e8 req-e755cb41-558e-4b25-8eb9-129aca683450 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:50.120362 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-34459e16-91e2-476f-8ea7-41ffc0ee69e8 req-e755cb41-558e-4b25-8eb9-129aca683450 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:50.134745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-34459e16-91e2-476f-8ea7-41ffc0ee69e8 req-e755cb41-558e-4b25-8eb9-129aca683450 service nova] Creating event network-vif-deleted:a96c2f08-a914-47c2-b41e-30eb8c3f0faa for instance 2891ad36-504d-4c32-a783-6d93e3a4b43b on hv-cinder-85220 Sep 06 16:28:50.141251 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-34459e16-91e2-476f-8ea7-41ffc0ee69e8 req-e755cb41-558e-4b25-8eb9-129aca683450 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037550 Sep 06 16:28:50.141864 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 640/1216] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:28:50.658471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:50.659167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:50.667129 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:50.667727 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:50.668389 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:50.669097 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:50.669555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:50.670168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:50.710347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:50.710971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:50.711486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:50.711947 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lazy-loading 'fault' on Instance uuid 2891ad36-504d-4c32-a783-6d93e3a4b43b {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:28:50.763425 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:50.775378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:50.775913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:50.777113 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f0d7d55f-6fbc-4830-a99e-c15f00e52a53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 200 len: 1370 microversion: 2.20 time: 0.122808 Sep 06 16:28:50.777693 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 577/1217] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:50 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 1370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:28:51.803002 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:51.803736 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:51.810325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:51.810855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:51.811299 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:51.811993 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:51.812442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:51.812866 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:51.827120 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] HTTP exception thrown: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Request method failure captured: Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b HTTP/1.1 Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Qu-SHpcC2DUXWVl-VVD4lBPSU77T5_xatPlv5sK3vjiODwnGRiyHnxs-RU1A82XT2Pe9dqQD-jLNQcHoJpLXWc-x6-lDO4MsdmeZjxEBNSu51Xy72q2k4o4wz9thR-sBcySJ3A3vgxWoVwKy3ZjBkJkIonrhdL1VX82lV6pOhkCZo Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:28:51.828820 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0679691b1c674dc4968638b8a93d4858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 66df80c268094c48abf73f1323aa23de Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:28:51.830997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '2891ad36-504d-4c32-a783-6d93e3a4b43b'} Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:28:51.832034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:28:51.834501 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:28:51.835997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Returning 404 to user: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:28:51.835997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-974b1918-c7f9-4242-8f32-49700b736dae tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 404 len: 111 microversion: 2.20 time: 0.032032 Sep 06 16:28:51.835997 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 641/1218] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:51 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:28:51.840376 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8c80c9d3-de61-4117-8984-83985105e3c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '.version_select at 0x7f21b84ea5e0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:51.859680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8c80c9d3-de61-4117-8984-83985105e3c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-425751295" status: 204 len: 0 microversion: 2.20 time: 0.023196 Sep 06 16:28:51.861013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 578/1219] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Sep 6 16:28:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-425751295 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 16:28:52.508012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5fd512fa-c86d-4a98-8bfe-4b163ff61adc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'create', calling method: .version_select at 0x7f21b804e700>, body: {"keypair": {"name": "tempest-keypair-827175527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcgOASfs5/kJBsDcIdkFrVS4LmRCL6643sEjNrmYlcsVyTUytjwatIFB1aa+Mq1+AFBe24k11hJ+9aSFkRTe4GZUoO1hcJaihz95XZzahzRu5goO6QuQ7bF6NtVZ6OthQ=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:52.523345 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-5fd512fa-c86d-4a98-8bfe-4b163ff61adc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for project 0679691b1c674dc4968638b8a93d4858. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:28:52.527364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-5fd512fa-c86d-4a98-8bfe-4b163ff61adc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for user 66df80c268094c48abf73f1323aa23de and project 0679691b1c674dc4968638b8a93d4858. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:28:52.549594 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5fd512fa-c86d-4a98-8bfe-4b163ff61adc tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046529 Sep 06 16:28:52.550175 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 642/1220] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Sep 6 16:28:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 16:28:53.851419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-425598344", "imageRef": "35b64588-3045-4f31-a0b9-8d496cc8a1b7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fc1df11-bf93-4c37-9640-5ebe913b0cfa"}], "security_groups": [{"name": "tempest-securitygroup--1836287517"}], "key_name": "tempest-keypair-827175527", "user_data": "}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:53.954929 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] validate_networks() for [('9fc1df11-bf93-4c37-9640-5ebe913b0cfa', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:28:54.599980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:28:54.600405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:28:54.600883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:28:54.601292 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:28:54.601706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:28:54.610764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:54.611242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:54.611674 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:54.612395 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:54.612844 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:54.613266 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:54.631256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for project 0679691b1c674dc4968638b8a93d4858. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:28:54.635224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Getting quotas for user 66df80c268094c48abf73f1323aa23de and project 0679691b1c674dc4968638b8a93d4858. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:28:54.647215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:28:54.649515 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='35b64588-3045-4f31-a0b9-8d496cc8a1b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:28:54.700471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-24561f40-2222-4033-a448-1e56d9d121d1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.853857 Sep 06 16:28:54.701102 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 579/1221] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Sep 6 16:28:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 16:28:54.713775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-08e66198-4296-4718-9049-eb3651a711a4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:54.714384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08e66198-4296-4718-9049-eb3651a711a4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:54.772248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08e66198-4296-4718-9049-eb3651a711a4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:54.780392 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08e66198-4296-4718-9049-eb3651a711a4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:54.781863 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08e66198-4296-4718-9049-eb3651a711a4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:54.783000 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-08e66198-4296-4718-9049-eb3651a711a4 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1280 microversion: 2.20 time: 0.073236 Sep 06 16:28:54.783580 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 643/1222] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:54 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:28:55.818743 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:55.819317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:55.825952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:55.826842 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:55.827352 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:55.828282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:55.828740 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:55.829430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:55.919883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:55.929729 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:55.931218 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:55.932336 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3a5b6de1-2707-4107-b060-544240416b6b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1340 microversion: 2.20 time: 0.119118 Sep 06 16:28:55.932895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 580/1223] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:55 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1340 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:28:56.958503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:56.959250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:56.965630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:56.966101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:56.966530 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:56.967257 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:56.967737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:56.968154 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:57.102015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:57.110647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:57.112106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:57.113374 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c921785f-ea0a-426f-b649-57134056408b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1406 microversion: 2.20 time: 0.159736 Sep 06 16:28:57.127126 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 644/1224] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:56 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:28:57.319749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-99d97ee8-b51e-4ec7-bd8c-90fb347f1d31 req-6bf24a34-18a6-4cc2-9363-01b4bb1dde23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30076bb9-d5e3-4879-a723-e8a07b26004f", "tag": "3ee1c33f-4652-4e43-a0c2-5d3a77693fb3"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:28:57.331104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-99d97ee8-b51e-4ec7-bd8c-90fb347f1d31 req-6bf24a34-18a6-4cc2-9363-01b4bb1dde23 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:57.332140 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-99d97ee8-b51e-4ec7-bd8c-90fb347f1d31 req-6bf24a34-18a6-4cc2-9363-01b4bb1dde23 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:57.333427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-99d97ee8-b51e-4ec7-bd8c-90fb347f1d31 req-6bf24a34-18a6-4cc2-9363-01b4bb1dde23 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:57.346764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-99d97ee8-b51e-4ec7-bd8c-90fb347f1d31 req-6bf24a34-18a6-4cc2-9363-01b4bb1dde23 service nova] Creating event network-changed:3ee1c33f-4652-4e43-a0c2-5d3a77693fb3 for instance 30076bb9-d5e3-4879-a723-e8a07b26004f on hv-cinder-85220 Sep 06 16:28:57.352103 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-99d97ee8-b51e-4ec7-bd8c-90fb347f1d31 req-6bf24a34-18a6-4cc2-9363-01b4bb1dde23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036704 Sep 06 16:28:57.352717 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 581/1225] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:28:58.139351 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:58.139945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:58.147500 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:58.147985 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:58.148417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:58.149108 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:58.149557 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:58.149975 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:58.282084 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:58.290394 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:58.291872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:58.292969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-83eaa713-ba98-46ae-9c44-5833f4dd0657 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1406 microversion: 2.20 time: 0.157589 Sep 06 16:28:58.293529 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 645/1226] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:58 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:28:59.318274 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:28:59.318996 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:28:59.325148 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:59.325634 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:59.326076 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:59.326797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:28:59.327252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:28:59.327724 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:28:59.461611 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:59.469679 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:59.471145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:28:59.472250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ec480b26-a8ee-4b92-ae08-47349fdf7a0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1406 microversion: 2.20 time: 0.158969 Sep 06 16:28:59.472808 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 582/1227] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:28:59 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:29:00.497319 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:00.497859 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:00.504773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:00.505273 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:00.505786 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:00.506576 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:00.507056 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:00.507485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:00.641083 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:00.649240 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:00.650693 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:00.651786 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1fec3baf-f672-4d23-ba6f-2af3dcb00b3c tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1406 microversion: 2.20 time: 0.158691 Sep 06 16:29:00.652332 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 646/1228] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:29:00 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:29:01.677925 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:01.678526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:01.684940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:01.685412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:01.685848 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:01.686535 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:01.687011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:01.687424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:01.823289 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:01.831812 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:01.833360 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:01.834491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-58a71cf8-b5f9-4ad7-b532-198b2215770d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1406 microversion: 2.20 time: 0.161290 Sep 06 16:29:01.835095 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 583/1229] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:29:01 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:29:02.327945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-bb23147b-f23c-42fb-8d99-42aad6c7e270 req-dc684660-5684-4fd9-b746-26c210fa4b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30076bb9-d5e3-4879-a723-e8a07b26004f", "name": "network-vif-plugged", "status": "completed", "tag": "3ee1c33f-4652-4e43-a0c2-5d3a77693fb3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:02.339220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bb23147b-f23c-42fb-8d99-42aad6c7e270 req-dc684660-5684-4fd9-b746-26c210fa4b14 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:02.339699 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bb23147b-f23c-42fb-8d99-42aad6c7e270 req-dc684660-5684-4fd9-b746-26c210fa4b14 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:02.340186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bb23147b-f23c-42fb-8d99-42aad6c7e270 req-dc684660-5684-4fd9-b746-26c210fa4b14 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:02.352419 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-bb23147b-f23c-42fb-8d99-42aad6c7e270 req-dc684660-5684-4fd9-b746-26c210fa4b14 service nova] Creating event network-vif-plugged:3ee1c33f-4652-4e43-a0c2-5d3a77693fb3 for instance 30076bb9-d5e3-4879-a723-e8a07b26004f on hv-cinder-85220 Sep 06 16:29:02.357339 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-bb23147b-f23c-42fb-8d99-42aad6c7e270 req-dc684660-5684-4fd9-b746-26c210fa4b14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033395 Sep 06 16:29:02.357933 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 647/1230] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:29:02.858782 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:02.859492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:02.866427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:02.866937 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:02.867372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:02.868058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:02.868503 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:02.868925 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:03.004436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:03.012248 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:03.013700 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:03.014859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-470fe6a4-0e0d-47fc-9de7-0359a17d16b6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1406 microversion: 2.20 time: 0.159986 Sep 06 16:29:03.015430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 584/1231] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:29:02 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:29:04.040787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:04.041385 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:04.047543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:04.048025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:04.048461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:04.049150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:04.049605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:04.050031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:04.184328 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:04.193204 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:04.194796 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:04.195911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-efdf0ddc-6870-4ee3-9a3a-5b695b8d1461 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1406 microversion: 2.20 time: 0.160250 Sep 06 16:29:04.196471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 648/1232] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:29:04 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:29:05.225192 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:05.225791 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:05.228286 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:05.229178 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:05.234984 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:05.235473 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:05.235913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:05.236609 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:05.237063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:05.237489 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:05.367890 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:05.376011 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:05.377463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:29:05.378619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ec67754b-67c6-40b4-8e7d-d1c8152c15e2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1597 microversion: 2.20 time: 0.160937 Sep 06 16:29:05.379220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 585/1233] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:29:05 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:29:05.403654 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:29:05.404205 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:29:05.406059 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:29:05.412774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:05.413258 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:05.413698 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:05.414393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:05.414896 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:05.415318 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:05.494360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d3977f8c-fd48-4e21-bead-142a834edeb6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094582 Sep 06 16:29:05.494991 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 649/1234] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Sep 6 16:29:05 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:29:06.453520 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-8aa9a75a-ed1d-4fe3-9a95-34c79ab06d91 req-1cfe89d7-6719-497c-87ac-6f4df56b6f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30076bb9-d5e3-4879-a723-e8a07b26004f", "tag": "3ee1c33f-4652-4e43-a0c2-5d3a77693fb3"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:29:06.463880 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8aa9a75a-ed1d-4fe3-9a95-34c79ab06d91 req-1cfe89d7-6719-497c-87ac-6f4df56b6f99 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:29:06.464367 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8aa9a75a-ed1d-4fe3-9a95-34c79ab06d91 req-1cfe89d7-6719-497c-87ac-6f4df56b6f99 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:29:06.464799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-8aa9a75a-ed1d-4fe3-9a95-34c79ab06d91 req-1cfe89d7-6719-497c-87ac-6f4df56b6f99 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:29:06.476841 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-8aa9a75a-ed1d-4fe3-9a95-34c79ab06d91 req-1cfe89d7-6719-497c-87ac-6f4df56b6f99 service nova] Creating event network-changed:3ee1c33f-4652-4e43-a0c2-5d3a77693fb3 for instance 30076bb9-d5e3-4879-a723-e8a07b26004f on hv-cinder-85220 Sep 06 16:29:06.482273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-8aa9a75a-ed1d-4fe3-9a95-34c79ab06d91 req-1cfe89d7-6719-497c-87ac-6f4df56b6f99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032469 Sep 06 16:29:06.483387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 586/1235] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:06.644692 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:06.645514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:06.650287 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:06.650824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:06.659330 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:06.660558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:06.661012 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:06.661707 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:06.662180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:06.662605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:06.691768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:30:06.769075 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2afce04c-e209-4033-9c68-46d8062099c3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 204 len: 0 microversion: 2.1 time: 0.126382 Sep 06 16:30:06.770806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 650/1236] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:30:06 2022] DELETE /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:30:06.777468 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:06.778217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:06.782534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:06.783260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:06.792258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:06.792734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:06.793169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:06.793852 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:06.794325 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:06.794773 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:07.099312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:07.106949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-53af8c55-f1fd-4d22-b949-e3742c3e2988 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1579 microversion: 2.1 time: 0.331698 Sep 06 16:30:07.107517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 587/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:06 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1579 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:08.129942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:08.130562 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:08.136960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:08.137432 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:08.137861 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:08.138536 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:08.139001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:08.139416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:08.333431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:08.341409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a013276e-afc4-475a-a23e-c79750dd7078 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1579 microversion: 2.1 time: 0.215736 Sep 06 16:30:08.341986 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 651/1238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:08 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1579 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:09.365641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:09.366273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:09.373851 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:09.374938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:09.375387 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:09.376122 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:09.376650 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:09.377086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:09.464995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:09.473538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1f15a963-83c6-4782-b486-0cd23de7de54 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1511 microversion: 2.1 time: 0.111664 Sep 06 16:30:09.474121 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 588/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:09 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:09.655187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-4401e44e-29b1-44a0-b1ac-f41a26473885 req-cc72c5a4-7582-4bc6-9661-54c4ba4f96bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4e8266-0821-4d32-98eb-be879841b7c2", "name": "network-vif-deleted", "tag": "6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:09.669337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4401e44e-29b1-44a0-b1ac-f41a26473885 req-cc72c5a4-7582-4bc6-9661-54c4ba4f96bb service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:09.670111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4401e44e-29b1-44a0-b1ac-f41a26473885 req-cc72c5a4-7582-4bc6-9661-54c4ba4f96bb service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:09.670829 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4401e44e-29b1-44a0-b1ac-f41a26473885 req-cc72c5a4-7582-4bc6-9661-54c4ba4f96bb service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:09.690574 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-4401e44e-29b1-44a0-b1ac-f41a26473885 req-cc72c5a4-7582-4bc6-9661-54c4ba4f96bb service nova] Creating event network-vif-deleted:6f1ba585-f4eb-43cb-bbc8-02d07d6d7db3 for instance 6e4e8266-0821-4d32-98eb-be879841b7c2 on hv-cinder-85220 Sep 06 16:30:09.699592 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-4401e44e-29b1-44a0-b1ac-f41a26473885 req-cc72c5a4-7582-4bc6-9661-54c4ba4f96bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050874 Sep 06 16:30:09.700201 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 652/1240] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:10.496798 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:10.497534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:10.505365 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:10.505927 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:10.506301 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:10.507086 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:10.507728 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:10.508362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:10.544312 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:10.544961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:10.545403 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:10.545889 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lazy-loading 'fault' on Instance uuid 6e4e8266-0821-4d32-98eb-be879841b7c2 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:30:10.590787 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:10.604008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4aad92d3-a51f-4356-8dde-ff83032c0cfe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 200 len: 1184 microversion: 2.1 time: 0.110663 Sep 06 16:30:10.604249 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 589/1241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:10 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 1184 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:11.626973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:11.627661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:11.634672 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:11.635160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:11.635589 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:11.636269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:11.636830 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:11.637130 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:11.650208 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] HTTP exception thrown: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Request method failure captured: Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 HTTP/1.1 Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3S1dZmUtAljM6kOhAXWhZLDYhE3zTuZTZ5fX52-A-6J7HY2OFD5SQomNGwLNKggF2QdGJbmr8038pjSm-ie353Mf5bB98Cs84y6SEM2BH7LBBgXrqsi9hZjDZ2kFQEFk93uuxCuSPLWUaJSMFRsnN6-jE8Ju_zPEnjV1p5R5e_tjEQ Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:30:11.651888 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 210d0f461d2c445a9688bc233d048079 Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:30:11.654460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '6e4e8266-0821-4d32-98eb-be879841b7c2'} Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:30:11.655903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:30:11.658402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:30:11.660687 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Returning 404 to user: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:30:11.660687 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b0fb9bd5-897d-4885-9c4e-d7e2323c34d3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 404 len: 111 microversion: 2.1 time: 0.030566 Sep 06 16:30:11.660687 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 653/1242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:11 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:30:11.756976 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-129637279", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-212657060", "security_groups": [{"name": "tempest-secgroup-smoke-1209426615"}], "block_device_mapping_v2": [{"uuid": "a8ec68a0-abe8-439f-9d21-fff9b8c9459b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8447cde-2775-41af-9b27-fe16e441705f"}]}} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:11.884329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.network.neutron [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] validate_networks() for [('e8447cde-2775-41af-9b27-fe16e441705f', None, None, None, None, None)] {{(pid=120738) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:30:12.257938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Flavor limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:30:12.258356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Image limits 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:30:12.258859 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Flavor pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:30:12.259268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Image pref 0:0:0 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:30:12.259678 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.virt.hardware [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120738) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:30:12.268544 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:12.269020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:12.269449 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:12.270165 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:12.271256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:12.271926 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:12.289671 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:30:12.293625 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.quota [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for user 210d0f461d2c445a9688bc233d048079 and project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120738) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:30:12.350803 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Going to run 1 instances... {{(pid=120738) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:30:12.352936 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8ec68a0-abe8-439f-9d21-fff9b8c9459b',volume_size=None,volume_type=None)] {{(pid=120738) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:30:12.491669 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ffc7135c-5d52-4c7b-97fd-bed6a9444450 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.738717 Sep 06 16:30:12.492326 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 590/1243] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:30:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 16:30:12.504413 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9bc1efb6-38c4-4720-b55a-0a4436214994 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:12.505948 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9bc1efb6-38c4-4720-b55a-0a4436214994 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:12.582732 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9bc1efb6-38c4-4720-b55a-0a4436214994 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:12.591170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9bc1efb6-38c4-4720-b55a-0a4436214994 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1093 microversion: 2.1 time: 0.091469 Sep 06 16:30:12.603081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 654/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:12 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:13.615405 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:13.616019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:13.622979 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:13.623552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:13.623924 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:13.624801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:13.625275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:13.625703 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:13.720734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:13.729485 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4e78f00c-946c-431d-9281-6055a6c94c23 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1191 microversion: 2.1 time: 0.118387 Sep 06 16:30:13.730058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 591/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:13 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:14.753604 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:14.754216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:14.762359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:14.763115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:14.763719 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:14.764417 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:14.764862 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:14.765278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:14.904790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:14.912892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3358af6f-0c0b-47a0-b4b4-8cbc5b45d297 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.163353 Sep 06 16:30:14.913460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 655/1246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:14 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:15.394897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-5372e0ca-eee2-44b7-aefc-2ae7945d4951 req-7c337bc5-fdd1-4ed0-99fa-f6d3208ceb11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ee111f-6f13-4bf2-8689-2801820531c7", "tag": "d72505b4-7d71-45c0-b7f6-c83047cebb86"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:15.405157 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5372e0ca-eee2-44b7-aefc-2ae7945d4951 req-7c337bc5-fdd1-4ed0-99fa-f6d3208ceb11 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:15.405646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5372e0ca-eee2-44b7-aefc-2ae7945d4951 req-7c337bc5-fdd1-4ed0-99fa-f6d3208ceb11 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:15.406085 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-5372e0ca-eee2-44b7-aefc-2ae7945d4951 req-7c337bc5-fdd1-4ed0-99fa-f6d3208ceb11 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:15.418004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-5372e0ca-eee2-44b7-aefc-2ae7945d4951 req-7c337bc5-fdd1-4ed0-99fa-f6d3208ceb11 service nova] Creating event network-changed:d72505b4-7d71-45c0-b7f6-c83047cebb86 for instance c5ee111f-6f13-4bf2-8689-2801820531c7 on hv-cinder-85220 Sep 06 16:30:15.422952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-5372e0ca-eee2-44b7-aefc-2ae7945d4951 req-7c337bc5-fdd1-4ed0-99fa-f6d3208ceb11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100264 Sep 06 16:30:15.423555 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 592/1247] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:15.935876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:15.936482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:15.943650 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:15.944052 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:15.944479 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:15.945163 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:15.945638 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:15.946053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:16.076936 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:16.085383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8ef875f0-5fba-45e6-bd91-5456cba4a431 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.153420 Sep 06 16:30:16.085945 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 656/1248] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:15 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:17.108464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:17.109168 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:17.116050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:17.116536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:17.116974 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:17.117940 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:17.118402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:17.118870 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:17.309918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:17.320365 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-796d872c-4733-4260-a78e-3519a7bda982 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.216654 Sep 06 16:30:17.320939 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 593/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:17 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:18.343356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:18.344010 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:18.350639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:18.351152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:18.351593 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:18.352295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:18.352745 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:18.353171 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:18.487653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:18.496364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-06aa09cb-30fd-4d46-8fce-3409faa067a5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.156901 Sep 06 16:30:18.496930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 657/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:18 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:19.521144 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:19.521766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:19.528421 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:19.528901 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:19.529344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:19.530046 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:19.530500 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:19.530961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:19.673872 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:19.681536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-09ee770f-2ab8-4547-9bbf-f55becdf3658 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.164515 Sep 06 16:30:19.682099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 594/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:19 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:30:20.704372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:20.704971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:20.712727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:20.713199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:20.713631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:20.714316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:20.714783 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:20.715200 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:20.854854 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:20.862486 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-486499f4-30cf-4b33-a1f8-90ef207d2ae5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.162006 Sep 06 16:30:20.863082 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 658/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:20 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:21.446832 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:21.447350 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:21.453346 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:21.453830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:21.454270 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:21.454998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:21.455450 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:21.456139 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:21.479673 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-048b1c5f-f35f-4aaa-a4d8-b1d86a24b5e3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/ips" status: 200 len: 150 microversion: 2.20 time: 0.092382 Sep 06 16:30:21.480232 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 595/1253] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Sep 6 16:30:21 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:30:21.885565 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:21.886186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:21.892784 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:21.893279 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:21.893871 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:21.894429 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:21.895115 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:21.895554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:22.030044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:22.038018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bd41bde4-5676-4a00-bbc5-56c5b21792e8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.156365 Sep 06 16:30:22.038584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 659/1254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:21 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:23.061306 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:23.061912 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:23.063929 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:23.064783 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=6 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:23.072138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:23.072626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:23.073062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:23.073760 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:23.074213 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:23.074637 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:23.219900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:23.228197 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a29ec70d-1a88-4840-9499-83b79f784040 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.170787 Sep 06 16:30:23.228769 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 596/1255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:23 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:30:23.285800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:23.286925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:23.288813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:23.294463 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:23.294976 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:23.295412 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:23.296106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:23.296565 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:23.296994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:23.320802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lazy-loading 'flavor' on Instance uuid 30076bb9-d5e3-4879-a723-e8a07b26004f {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:30:23.517242 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-742a2cef-981f-45ad-9d7f-61c922bba545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/action" status: 202 len: 0 microversion: 2.20 time: 0.235207 Sep 06 16:30:23.517838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 660/1256] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Sep 6 16:30:23 2022] POST /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:30:23.526796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:23.527420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:23.533802 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:23.534305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:23.534776 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:23.535600 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:23.536204 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:23.537313 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:23.671264 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:23.680334 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:23.681810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:23.683013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a4d27579-3edc-4fe4-b0cd-9fdf969d7e7f tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.160146 Sep 06 16:30:23.683607 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 597/1257] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:23 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:24.252792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:24.253499 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:24.260911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:24.261420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:24.261832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:24.262647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:24.263128 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:24.263555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:24.397516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:24.405294 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-452f656b-b4dc-4fec-bfce-20e5dee12688 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.156769 Sep 06 16:30:24.405846 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 661/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:24 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:24.709644 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:24.710419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:24.716911 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:24.717392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:24.717823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:24.718518 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:24.718993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:24.719417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:24.861098 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:24.871792 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:24.873256 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:24.874451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1f28e47f-ddd2-4495-ae89-29edd50ac2c1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.169610 Sep 06 16:30:24.875042 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 598/1259] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:24 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:25.429653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:25.430328 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:25.437558 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:25.438043 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:25.438484 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:25.439220 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:25.439677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:25.440105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:25.581381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:25.590358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3b6ff91c-a861-40aa-9c80-34c4c9c28208 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.165591 Sep 06 16:30:25.590978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 662/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:25 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:25.902556 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:25.903196 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:25.910097 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:25.910570 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:25.911052 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:25.912364 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:25.912814 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:25.913235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:26.049683 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:26.057929 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:26.059416 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:26.060626 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fd191782-95a9-4cdb-b691-549ea714338b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.162155 Sep 06 16:30:26.061190 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 599/1261] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:25 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:26.616252 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:26.616969 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:26.623521 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:26.624015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:26.624452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:26.625157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:26.625612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:26.626038 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:26.765673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:26.779647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7795639a-dc70-452e-bf98-e3542eb3e0ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.167967 Sep 06 16:30:26.780329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 663/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:26 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:26.833662 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-4fb439d1-6d58-492c-b17a-3d8a601334b6 req-7dc67848-f801-4dd1-b41a-e8cd7e678400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ee111f-6f13-4bf2-8689-2801820531c7", "name": "network-vif-plugged", "status": "completed", "tag": "d72505b4-7d71-45c0-b7f6-c83047cebb86"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:26.843172 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4fb439d1-6d58-492c-b17a-3d8a601334b6 req-7dc67848-f801-4dd1-b41a-e8cd7e678400 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:26.843645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4fb439d1-6d58-492c-b17a-3d8a601334b6 req-7dc67848-f801-4dd1-b41a-e8cd7e678400 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:26.844077 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4fb439d1-6d58-492c-b17a-3d8a601334b6 req-7dc67848-f801-4dd1-b41a-e8cd7e678400 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:26.856228 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-4fb439d1-6d58-492c-b17a-3d8a601334b6 req-7dc67848-f801-4dd1-b41a-e8cd7e678400 service nova] Creating event network-vif-plugged:d72505b4-7d71-45c0-b7f6-c83047cebb86 for instance c5ee111f-6f13-4bf2-8689-2801820531c7 on hv-cinder-85220 Sep 06 16:30:26.861142 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-4fb439d1-6d58-492c-b17a-3d8a601334b6 req-7dc67848-f801-4dd1-b41a-e8cd7e678400 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092825 Sep 06 16:30:26.861746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 600/1263] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:30:27.087169 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:27.087809 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:27.093794 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:27.094289 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:27.094731 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:27.095431 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:27.096105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:27.096688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:27.230034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:27.238338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:27.240476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:27.241792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d102a37e-81ca-446c-b54a-b28700343be5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.159185 Sep 06 16:30:27.242347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 664/1264] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:27 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:27.805762 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:27.806454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:27.812659 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:27.813143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:27.813572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:27.814259 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:27.814728 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:27.815158 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:27.952476 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:27.960694 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8dae0d96-9b8a-4aa9-aef5-1d68af98cea0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1265 microversion: 2.1 time: 0.160113 Sep 06 16:30:27.961258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 601/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:27 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:28.267633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:28.268150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:28.276386 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:28.277150 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:28.277668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:28.278460 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:28.278950 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:28.279376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:28.283694 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:28.417343 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:28.425358 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:28.427471 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:28.428628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-54a0ef25-c859-4ad1-9d46-c63da65f9fcb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.165028 Sep 06 16:30:28.429189 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 665/1266] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:28 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:28.984682 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:28.985402 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:28.994882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:28.995508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:28.996067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:28.996921 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:28.997491 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:28.998202 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:29.141577 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:29.149734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1e73228d-69f1-4dce-bcc7-547dd8788ea9 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1453 microversion: 2.1 time: 0.169351 Sep 06 16:30:29.150316 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 602/1267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:28 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:29.172277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:29.172881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:29.180134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:29.180614 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:29.181046 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:29.181771 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:29.182221 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:29.182634 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:29.320306 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:29.328507 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-650d375b-5813-4164-9764-de416d34f035 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1453 microversion: 2.1 time: 0.160004 Sep 06 16:30:29.329092 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 666/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:30:29 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:30:29.453498 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:29.454109 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:29.461796 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:29.462740 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:29.463188 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:29.463913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:29.464370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:29.464799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:29.693392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:29.702299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:29.704757 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:29.705961 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ad968db3-c810-4982-81fa-0a5e9415ba09 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.256412 Sep 06 16:30:29.707015 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 603/1269] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:29 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:30.733346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:30.735645 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:30.746703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:30.746703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:30.746703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:30.746703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:30.747160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:30.747160 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:30.913620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:30.922740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:30.924452 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:30.925641 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-725df1d8-5a23-4625-b28b-550fee673e51 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.197207 Sep 06 16:30:30.926199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 667/1270] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:30 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:30:31.424050 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-4814a815-103b-4adc-b520-6e8df6929879 req-f12ad39b-5052-4963-a7de-7e1ae4876f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ee111f-6f13-4bf2-8689-2801820531c7", "tag": "d72505b4-7d71-45c0-b7f6-c83047cebb86"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:31.435001 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4814a815-103b-4adc-b520-6e8df6929879 req-f12ad39b-5052-4963-a7de-7e1ae4876f0c service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:31.436434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4814a815-103b-4adc-b520-6e8df6929879 req-f12ad39b-5052-4963-a7de-7e1ae4876f0c service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:31.436880 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-4814a815-103b-4adc-b520-6e8df6929879 req-f12ad39b-5052-4963-a7de-7e1ae4876f0c service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:31.449362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-4814a815-103b-4adc-b520-6e8df6929879 req-f12ad39b-5052-4963-a7de-7e1ae4876f0c service nova] Creating event network-changed:d72505b4-7d71-45c0-b7f6-c83047cebb86 for instance c5ee111f-6f13-4bf2-8689-2801820531c7 on hv-cinder-85220 Sep 06 16:30:31.455482 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-4814a815-103b-4adc-b520-6e8df6929879 req-f12ad39b-5052-4963-a7de-7e1ae4876f0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035097 Sep 06 16:30:31.456079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 604/1271] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:31.960034 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:31.961284 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:31.968899 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:31.970157 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:31.970612 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:31.971676 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:31.973217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:31.974061 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:32.423356 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:32.433528 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:32.435056 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:32.436298 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-53cf84a8-bb88-4926-a676-53ab46bfe2c9 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.487842 Sep 06 16:30:32.436870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 668/1272] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:31 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:33.468899 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:33.469590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:33.477023 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:33.477501 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:33.478107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:33.478633 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:33.479119 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:33.479532 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:33.681622 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:33.694210 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:33.695680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:33.696894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-4a26c9fb-d8f0-4cdc-9977-cd36e4caca81 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.237195 Sep 06 16:30:33.697462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 605/1273] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:33 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:34.723361 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:34.725341 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:34.732797 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:34.733278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:34.733711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:34.734409 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:34.734884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:34.735313 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:34.889266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:34.903755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:34.905192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:34.906376 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-64a77c40-c729-4110-af9e-68f81394ca01 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.186950 Sep 06 16:30:34.906980 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 669/1274] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:34 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:35.933687 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:35.934698 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:35.941420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:35.941900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:35.942343 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:35.943054 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:35.943499 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:35.943931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:35.949417 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=100 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:36.102136 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:36.110952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:36.112408 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:36.113590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-90c83dea-6c09-4dcb-87ee-f21347ba385b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1742 microversion: 2.20 time: 0.183890 Sep 06 16:30:36.114236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 606/1275] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:35 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:37.139818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:37.140418 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:37.142729 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:37.148981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:37.149498 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:37.149930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:37.150625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:37.151095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:37.151516 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:37.288266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:37.296989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:37.298447 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:37.299657 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-acc19266-c3e5-4b32-829e-24dd3cfc43ba tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1742 microversion: 2.20 time: 0.164010 Sep 06 16:30:37.300222 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 670/1276] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:37 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:38.327215 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:38.327835 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:38.330244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:38.335899 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:38.336394 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:38.336840 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:38.337543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:38.338000 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:38.338434 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:38.481918 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:38.491509 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:38.492991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:38.494210 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c8c33428-f6b8-4e60-85ea-cbea1d7fa1eb tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1742 microversion: 2.20 time: 0.171017 Sep 06 16:30:38.495141 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 607/1277] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:38 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:30:38.810391 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-a68b09e7-481d-49b3-8abe-1e787974c284 req-864ace21-898c-4795-840e-27749e06f37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30076bb9-d5e3-4879-a723-e8a07b26004f", "name": "network-vif-plugged", "status": "completed", "tag": "3ee1c33f-4652-4e43-a0c2-5d3a77693fb3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:38.824311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a68b09e7-481d-49b3-8abe-1e787974c284 req-864ace21-898c-4795-840e-27749e06f37f service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:38.824790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a68b09e7-481d-49b3-8abe-1e787974c284 req-864ace21-898c-4795-840e-27749e06f37f service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:38.825211 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a68b09e7-481d-49b3-8abe-1e787974c284 req-864ace21-898c-4795-840e-27749e06f37f service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:38.839787 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-a68b09e7-481d-49b3-8abe-1e787974c284 req-864ace21-898c-4795-840e-27749e06f37f service nova] Creating event network-vif-plugged:3ee1c33f-4652-4e43-a0c2-5d3a77693fb3 for instance 30076bb9-d5e3-4879-a723-e8a07b26004f on hv-cinder-85220 Sep 06 16:30:38.845337 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-a68b09e7-481d-49b3-8abe-1e787974c284 req-864ace21-898c-4795-840e-27749e06f37f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038708 Sep 06 16:30:38.846129 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 671/1278] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:30:39.523461 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:39.524090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:39.530822 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:39.531317 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:39.531774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:39.532470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:39.533060 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:39.533379 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:39.682608 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:39.690885 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:39.692338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:39.693519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-63b8b8b7-89fa-4c79-b1fd-f236ddf6c717 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1742 microversion: 2.20 time: 0.175099 Sep 06 16:30:39.694697 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 608/1279] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:39 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:40.724104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:40.725856 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:40.733414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:40.734309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:40.735032 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:40.735974 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:40.736631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:40.737122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:40.917634 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:40.929492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:40.931039 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:40.932469 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7bb50fad-70be-4102-b676-552ce6d94577 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.214130 Sep 06 16:30:40.933426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 672/1280] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:40 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:41.980305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:41.980908 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:41.989721 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:41.990299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:41.990943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:41.992250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:41.992948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:41.993379 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:42.153427 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:42.162723 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:42.164299 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:42.165619 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-1f89eb9c-5484-468c-ab98-00abc359b6a1 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.192037 Sep 06 16:30:42.166231 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 609/1281] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:41 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:43.192781 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:43.193519 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:43.200236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:43.200717 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:43.201164 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:43.201865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:43.202316 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:43.202768 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:43.368986 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:43.380178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:43.382706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:43.383962 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6236008b-278c-4a17-80ce-ed391d9ece57 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.195174 Sep 06 16:30:43.385163 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 673/1282] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:43 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:44.415643 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:44.416344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:44.424445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:44.424935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:44.425378 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:44.426169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:44.426733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:44.427715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:44.596088 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:44.608275 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:44.609969 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:44.611582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-82beff21-e5d7-4bf6-81fc-46c46e9eed0d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.201849 Sep 06 16:30:44.612268 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 610/1283] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:44 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:45.641030 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:45.641739 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:45.650620 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:45.651193 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:45.651635 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:45.652347 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:45.652825 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:45.653236 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:45.803990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:45.812737 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:45.814477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:45.815668 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a171a8c3-9ad2-45b5-acef-ad127114f844 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.178899 Sep 06 16:30:45.818698 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 674/1284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:45 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:46.845957 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:46.847049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:46.855613 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:46.855990 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:46.856642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:46.857199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:46.857679 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:46.858117 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:47.052199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:47.064330 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:47.065454 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:47.067210 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-938c9369-056a-4475-9d38-ac21951c7b17 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.226082 Sep 06 16:30:47.068227 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 611/1285] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:46 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:48.106422 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:48.107838 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:48.117911 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:48.118500 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:48.119059 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:48.119776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:48.120227 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:48.120653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:48.278832 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:48.287267 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:48.289377 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:48.290619 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-05372e3f-a8b4-4241-a079-3f7f21ac4969 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.191895 Sep 06 16:30:48.291277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 675/1286] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:48 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:49.328795 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:49.331058 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:49.345554 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:49.346357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:49.346991 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:49.347900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:49.348505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:49.349074 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:49.534359 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:49.543620 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:49.544993 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:49.546453 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-e404d070-2352-4840-afe8-f32d27bb58c5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.231858 Sep 06 16:30:49.547087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 612/1287] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:49 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:50.583365 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:50.583972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:50.591011 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:50.591494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:50.591927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:50.592630 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:50.593074 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:50.593606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:50.745741 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:50.753949 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:50.755480 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:50.757051 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3fc2d469-f5a7-47ce-a245-904d1d80cddd tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1737 microversion: 2.20 time: 0.178225 Sep 06 16:30:50.757688 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 676/1288] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:50 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:51.783363 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:51.783985 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:51.790979 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:51.791469 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:51.791913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:51.792623 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:51.793076 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:51.793505 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:52.030338 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:52.038858 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:52.040510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:52.041470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-959c4417-59a9-4227-bfbc-169a8eb9d248 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1719 microversion: 2.20 time: 0.262136 Sep 06 16:30:52.043764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 613/1289] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:51 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1719 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:53.069491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:53.070102 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:53.076775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:53.077262 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:53.077703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:53.078401 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:53.078876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:53.079308 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:53.218881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:53.227696 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:53.229131 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:53.230301 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e61de0f0-5892-4347-9836-b8c0650391fe tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1719 microversion: 2.20 time: 0.165627 Sep 06 16:30:53.230901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 677/1290] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:53 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:54.257979 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:54.258567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:54.265154 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.265634 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.266069 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.266808 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.267258 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.267680 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.405463 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:54.414550 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:54.416026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:54.417242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2accab16-1490-4369-86ad-fe73a6a77a47 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1722 microversion: 2.20 time: 0.164348 Sep 06 16:30:54.417861 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 614/1291] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:54 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:30:54.450106 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d0e2b44-aa53-4b89-88f5-5e113f279b8f"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:54.452491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:54.461105 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.461607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.462045 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.462791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.463246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.463733 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.768192 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0c9d66b1-fe05-418e-8d83-388112ca3067 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322161 Sep 06 16:30:54.769000 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 678/1292] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Sep 6 16:30:54 2022] POST /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 16:30:54.818422 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-9f5dfc9e-fc85-4c6c-9ec5-464c151b3007 req-a230e8c1-d217-4078-8729-747bd6adbc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30076bb9-d5e3-4879-a723-e8a07b26004f", "name": "network-vif-unplugged", "status": "completed", "tag": "3ee1c33f-4652-4e43-a0c2-5d3a77693fb3"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:54.837748 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-9f5dfc9e-fc85-4c6c-9ec5-464c151b3007 req-a230e8c1-d217-4078-8729-747bd6adbc27 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.838347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-9f5dfc9e-fc85-4c6c-9ec5-464c151b3007 req-a230e8c1-d217-4078-8729-747bd6adbc27 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.838944 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-9f5dfc9e-fc85-4c6c-9ec5-464c151b3007 req-a230e8c1-d217-4078-8729-747bd6adbc27 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.853558 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.compute.server_external_events [req-9f5dfc9e-fc85-4c6c-9ec5-464c151b3007 req-a230e8c1-d217-4078-8729-747bd6adbc27 service nova] Unable to find a host for instance 30076bb9-d5e3-4879-a723-e8a07b26004f. Dropping event network-vif-unplugged {{(pid=120738) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 16:30:54.854474 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-9f5dfc9e-fc85-4c6c-9ec5-464c151b3007 req-a230e8c1-d217-4078-8729-747bd6adbc27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043593 Sep 06 16:30:54.855135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 615/1293] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 16:30:54.915324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:54.915822 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:54.922091 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.922578 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.923044 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:54.923759 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:54.924206 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:54.924631 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.003777 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:30:55.180156 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8c547511-715d-4a33-856c-a1a5a1a55be2 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-volume_attachments/9d0e2b44-aa53-4b89-88f5-5e113f279b8f" status: 202 len: 0 microversion: 2.20 time: 0.269143 Sep 06 16:30:55.180857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 679/1294] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Sep 6 16:30:54 2022] DELETE /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-volume_attachments/9d0e2b44-aa53-4b89-88f5-5e113f279b8f => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:30:55.254030 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:30:55.254631 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:55.262369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.263038 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.263329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.264015 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.264462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.264885 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.296112 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120738) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 16:30:55.370391 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3ee55c6c-56d2-4e28-b21f-dc0ba204a545 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "POST /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/action" status: 202 len: 0 microversion: 2.20 time: 0.120413 Sep 06 16:30:55.371380 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 616/1295] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Sep 6 16:30:55 2022] POST /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:30:55.379274 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:55.379883 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:55.387430 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.387913 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.388451 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.389179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:55.389626 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:55.389879 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:55.567168 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:55.577172 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:55.578760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:55.580077 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6b577ddd-2f94-4816-8bcb-65c41137a88a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1670 microversion: 2.20 time: 0.204813 Sep 06 16:30:55.580728 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 680/1296] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:55 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1670 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:56.623271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:56.623879 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:56.629860 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:56.630345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:56.630853 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:56.632169 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:56.632625 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:56.633063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:56.848774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:56.857219 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:56.858818 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:56.860004 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ac1e69c4-d8df-4810-aed5-7ca2adf0c533 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.241183 Sep 06 16:30:56.860560 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 617/1297] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:56 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:57.888906 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:57.890004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:57.897152 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:57.897670 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:57.898128 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:57.898881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:57.899340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:57.899908 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:58.060491 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:58.076923 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:58.078369 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:58.079603 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e42986b4-2ad2-4f86-bfbf-1fb27cf2ecbf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.196575 Sep 06 16:30:58.080174 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 681/1298] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:57 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:30:59.105549 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:30:59.106278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:30:59.113207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:59.113839 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:59.114385 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:59.115250 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:30:59.116641 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:30:59.117189 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:30:59.261706 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:59.270756 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:59.272244 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:30:59.273483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9b6c668d-27f7-45cd-92af-7b9e3a1a8e54 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.172034 Sep 06 16:30:59.274051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 618/1299] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:30:59 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:00.300887 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:00.302942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:00.310695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:00.311556 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:00.312238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:00.313047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:00.313751 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:00.314364 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:00.463509 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:00.471998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:00.473561 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:00.474682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1b64ef5e-71db-4685-b4b1-1e44dbf4f985 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.179012 Sep 06 16:31:00.475634 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 682/1300] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:00 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:01.502033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:01.502647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:01.509433 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:01.510026 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:01.510635 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:01.511442 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:01.513237 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:01.513856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:01.658964 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:01.668536 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:01.669980 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:01.671204 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-20b90319-5323-4060-b620-da84e12ade75 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.173535 Sep 06 16:31:01.671770 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 619/1301] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:01 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:02.698947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:02.699606 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:02.706203 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:02.706720 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:02.707420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:02.708132 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:02.708582 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:02.709009 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:02.849024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:02.859776 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:02.861173 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:02.862346 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bff6338b-e32f-48ce-8982-f59b430206d3 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.168701 Sep 06 16:31:02.862937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 683/1302] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:02 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:31:03.888567 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:03.889124 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:03.895759 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:03.896243 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:03.897430 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:03.898343 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:03.898760 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:03.899182 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:04.056824 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:04.065133 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:04.066564 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:04.067745 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-60769c0a-ce09-42f4-9e53-06fa06b79745 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.183211 Sep 06 16:31:04.068305 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 620/1303] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:03 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:05.096357 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:05.096955 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:05.104320 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:05.104807 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:05.105246 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:05.105961 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:05.106414 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:05.106869 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:05.257625 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:05.266775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:05.268233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:05.269443 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-18f48ba0-872d-46b9-b6e7-44ea03d8a5f5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.177052 Sep 06 16:31:05.270006 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 684/1304] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:05 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:06.295492 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:06.296111 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:06.302681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:06.303255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:06.304007 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:06.304719 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:06.305171 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:06.305590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:06.308432 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:06.448441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:06.463646 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:06.465072 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:06.466229 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2ae1359a-5bce-4edd-a989-80cc0be7b1c0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.174721 Sep 06 16:31:06.466812 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 621/1305] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:06 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:07.492099 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:07.492697 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:07.495031 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=30 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:07.500223 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:07.500695 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:07.501121 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:07.501802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:07.502238 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:07.502653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:07.635278 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:07.643384 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:07.644855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:07.646049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-581278af-53be-49b2-87da-5ff77089a4f0 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.158392 Sep 06 16:31:07.646722 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 685/1306] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:07 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:08.671799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:08.672412 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:08.674764 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:31:08.681118 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:08.681602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:08.682042 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:08.682772 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:08.683226 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:08.683657 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:08.815103 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:08.825233 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:08.826716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:08.827892 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f577129a-cf62-4194-aeac-d268aa5e7f21 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.159984 Sep 06 16:31:08.828630 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 622/1307] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:08 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:09.853910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:09.854458 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:09.861383 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:09.861858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:09.862295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:09.863047 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:09.863494 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:09.863914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:09.999959 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:10.009250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:10.010712 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:10.011885 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8566fcbd-33d3-46bf-b67f-589566884d85 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.162396 Sep 06 16:31:10.012449 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 686/1308] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:09 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:11.042459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:11.043062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:11.049897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:11.050368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:11.050826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:11.051513 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:11.051956 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:11.052373 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:11.195209 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:11.208329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:11.211138 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:11.212541 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a4841e7b-2d84-4577-a80f-ab4965362672 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.174686 Sep 06 16:31:11.213135 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 623/1309] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:11 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:12.239982 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:12.240607 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:12.247277 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:12.247775 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:12.248210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:12.248895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:12.249338 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:12.249753 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:12.381968 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:12.390492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:12.392058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:12.393233 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b28e7d27-a324-4546-a4ed-d4b64797a090 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.157311 Sep 06 16:31:12.393799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 687/1310] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:12 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:13.419110 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:13.419716 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:13.426224 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:13.426734 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:13.427207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:13.428494 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:13.429147 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:13.429580 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:13.563807 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:13.572392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:13.573823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:13.575022 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bb1d5962-1058-44b9-b36d-5c4bbcdee00d tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.159878 Sep 06 16:31:13.575579 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 624/1311] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:13 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:14.601195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:14.601755 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:14.608416 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:14.608892 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:14.609325 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:14.610018 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:14.610472 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:14.610927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:14.741981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:14.750269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:14.751799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:14.752990 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ecbd225b-43b6-4405-830a-a0a9645848e5 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.155935 Sep 06 16:31:14.753553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 688/1312] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:14 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:14.938478 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-af7af958-015a-4ad8-8543-b3261b69951c req-b3889d9b-49dc-4c1f-ba8d-ce24dbd1f57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30076bb9-d5e3-4879-a723-e8a07b26004f", "name": "network-vif-plugged", "status": "completed", "tag": "3ee1c33f-4652-4e43-a0c2-5d3a77693fb3"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:31:14.949013 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-af7af958-015a-4ad8-8543-b3261b69951c req-b3889d9b-49dc-4c1f-ba8d-ce24dbd1f57d service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:14.949497 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-af7af958-015a-4ad8-8543-b3261b69951c req-b3889d9b-49dc-4c1f-ba8d-ce24dbd1f57d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:14.949946 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-af7af958-015a-4ad8-8543-b3261b69951c req-b3889d9b-49dc-4c1f-ba8d-ce24dbd1f57d service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:14.962913 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-af7af958-015a-4ad8-8543-b3261b69951c req-b3889d9b-49dc-4c1f-ba8d-ce24dbd1f57d service nova] Creating event network-vif-plugged:3ee1c33f-4652-4e43-a0c2-5d3a77693fb3 for instance 30076bb9-d5e3-4879-a723-e8a07b26004f on hv-cinder-85220 Sep 06 16:31:14.967968 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-af7af958-015a-4ad8-8543-b3261b69951c req-b3889d9b-49dc-4c1f-ba8d-ce24dbd1f57d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 Sep 06 16:31:14.968569 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 625/1313] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:31:15.780934 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:15.780934 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:15.788048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:15.788531 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:15.788973 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:15.789673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:15.790126 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:15.790554 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:15.921743 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:15.930876 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:15.932396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:15.933548 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8adc6326-fc55-4f95-98cb-1cf1f42648a6 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.158390 Sep 06 16:31:15.934107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 689/1314] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:15 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:31:16.960833 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:16.961446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:16.968271 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:16.968757 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:16.969198 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:16.969900 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:16.970354 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:16.970815 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:17.107930 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:17.118025 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:17.119872 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:17.121061 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2c269bfb-7cbd-4985-8b8e-6b7334294c89 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1728 microversion: 2.20 time: 0.165500 Sep 06 16:31:17.121627 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 626/1315] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:16 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:31:18.148177 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:31:18.148799 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:31:18.155566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:18.156050 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:18.156520 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:18.157221 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:31:18.157677 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:31:18.158128 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:31:18.291872 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:18.299791 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:18.301210 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:31:18.302353 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-39f7ff1f-cc2a-43c1-89fe-69cb50327591 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1715 microversion: 2.20 time: 0.158856 Sep 06 16:31:18.302948 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 690/1316] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:31:18 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 16:32:16.970755 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=9 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:16.971493 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=31 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:16.972621 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:32:16.972766 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Tue Sep 6 16:32:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-volume_attachments (ip 10.222.0.26) !!! Sep 06 16:32:16.978775 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:16.980887 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:16.990565 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:16.991071 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:16.991510 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:16.992234 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:16.992688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:16.993531 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:17.025018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0d24dfd0-4aa1-4f74-87f2-2bab311a9087 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056003 Sep 06 16:32:17.025575 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 627/1317] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Sep 6 16:32:16 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:32:17.090710 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:17.091281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:17.093517 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=11 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:17.094174 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:17.095029 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:32:17.095178 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Tue Sep 6 16:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f (ip 10.222.0.26) !!! Sep 06 16:32:17.096715 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:32:17.096852 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Tue Sep 6 16:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f (ip 10.222.0.26) !!! Sep 06 16:32:17.111070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:17.111555 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:17.111995 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:17.112802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:17.113261 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:17.113685 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:17.142703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:32:17.219684 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b4f79549-a868-4a1c-8d13-27a419110056 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 204 len: 0 microversion: 2.20 time: 0.132447 Sep 06 16:32:17.220533 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 691/1318] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Sep 6 16:32:17 2022] DELETE /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 16:32:17.230150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:17.230782 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:17.237736 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:17.238222 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:17.238647 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:17.239361 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:17.239803 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:17.240221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:17.380897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:17.389442 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:17.391049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:17.392217 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f750b806-03b6-4caa-82a0-5ac7b3891f9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.167484 Sep 06 16:32:17.392799 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 628/1319] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:32:17 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:32:18.419340 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:18.420111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:18.426998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:18.427587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:18.428026 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:18.428718 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:18.429170 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:18.429596 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:18.566543 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:18.574587 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:18.576053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:18.577964 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bc96d544-231b-4cc6-8d44-068771dd6652 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.162591 Sep 06 16:32:18.578518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 692/1320] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:32:18 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:32:19.604486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:19.604486 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:19.612059 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:19.613392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:19.613392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:19.614041 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:19.614495 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:19.614950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:20.056481 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:20.064645 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:20.066143 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:20.067345 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-bee3ca99-75ce-4c5c-ae72-7af201a86e7b tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1721 microversion: 2.20 time: 0.467605 Sep 06 16:32:20.067911 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 629/1321] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:32:19 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1721 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:32:20.633998 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-4e419806-488e-459b-8401-b48b56439e19 req-69e08661-8fab-4801-9a89-d2669e8bc939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30076bb9-d5e3-4879-a723-e8a07b26004f", "name": "network-vif-deleted", "tag": "3ee1c33f-4652-4e43-a0c2-5d3a77693fb3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:32:20.647553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4e419806-488e-459b-8401-b48b56439e19 req-69e08661-8fab-4801-9a89-d2669e8bc939 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:20.648058 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4e419806-488e-459b-8401-b48b56439e19 req-69e08661-8fab-4801-9a89-d2669e8bc939 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:20.648489 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-4e419806-488e-459b-8401-b48b56439e19 req-69e08661-8fab-4801-9a89-d2669e8bc939 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:20.660895 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-4e419806-488e-459b-8401-b48b56439e19 req-69e08661-8fab-4801-9a89-d2669e8bc939 service nova] Creating event network-vif-deleted:3ee1c33f-4652-4e43-a0c2-5d3a77693fb3 for instance 30076bb9-d5e3-4879-a723-e8a07b26004f on hv-cinder-85220 Sep 06 16:32:20.666482 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-4e419806-488e-459b-8401-b48b56439e19 req-69e08661-8fab-4801-9a89-d2669e8bc939 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036171 Sep 06 16:32:20.667514 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 693/1322] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:32:21.093768 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:21.094420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:21.101526 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:21.102019 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:21.102457 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:21.103199 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:21.103655 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:21.104081 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:21.143595 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:21.144106 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:21.144552 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:21.145006 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lazy-loading 'fault' on Instance uuid 30076bb9-d5e3-4879-a723-e8a07b26004f {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:32:21.189146 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:21.197966 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:21.199451 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66df80c268094c48abf73f1323aa23de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0679691b1c674dc4968638b8a93d4858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:21.200718 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2e55deac-3bd2-4165-9ba6-9b4a52db7e9e tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 200 len: 1370 microversion: 2.20 time: 0.111073 Sep 06 16:32:21.201273 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 630/1323] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:32:21 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 16:32:22.229217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:22.229968 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:22.236349 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:22.236835 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:22.237265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:22.237960 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:22.238481 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:22.238981 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:22.253134 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] HTTP exception thrown: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Request method failure captured: Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f HTTP/1.1 Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Qu-SHpcC2DUXWVl-VVD4lBPSU77T5_xatPlv5sK3vjiODwnGRiyHnxs-RU1A82XT2Pe9dqQD-jLNQcHoJpLXWc-x6-lDO4MsdmeZjxEBNSu51Xy72q2k4o4wz9thR-sBcySJ3A3vgxWoVwKy3ZjBkJkIonrhdL1VX82lV6pOhkCZo Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:32:22.255264 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0679691b1c674dc4968638b8a93d4858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 66df80c268094c48abf73f1323aa23de Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:22.256971 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '30076bb9-d5e3-4879-a723-e8a07b26004f'} Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:32:22.258001 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:22.259760 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:22.261329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Returning 404 to user: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:32:22.261329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7277932c-da8c-45ec-837f-8e80a12fbe07 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 404 len: 111 microversion: 2.20 time: 0.032692 Sep 06 16:32:22.261329 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 694/1324] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:32:22 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:32:22.266437 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9299b646-2000-4565-82de-3ea62547e293 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '.version_select at 0x7f21bb813280>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:22.289750 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9299b646-2000-4565-82de-3ea62547e293 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-827175527" status: 204 len: 0 microversion: 2.20 time: 0.027843 Sep 06 16:32:22.290326 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 631/1325] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Sep 6 16:32:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-827175527 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 16:32:24.078891 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:24.079396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:24.085924 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:24.086402 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:24.086867 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:24.087553 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:24.088004 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:24.088427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:24.102269 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] HTTP exception thrown: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Request method failure captured: Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f HTTP/1.1 Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Qu-SHpcC2DUXWVl-VVD4lBPSU77T5_xatPlv5sK3vjiODwnGRiyHnxs-RU1A82XT2Pe9dqQD-jLNQcHoJpLXWc-x6-lDO4MsdmeZjxEBNSu51Xy72q2k4o4wz9thR-sBcySJ3A3vgxWoVwKy3ZjBkJkIonrhdL1VX82lV6pOhkCZo Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:32:24.103842 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0679691b1c674dc4968638b8a93d4858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 66df80c268094c48abf73f1323aa23de Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.105661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '30076bb9-d5e3-4879-a723-e8a07b26004f'} Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:32:24.106828 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.108476 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.110226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Returning 404 to user: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:32:24.110226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-777d2cab-e1dc-410d-9019-3919f3c6f34a tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 404 len: 111 microversion: 2.20 time: 0.031139 Sep 06 16:32:24.110226 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 695/1326] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Sep 6 16:32:24 2022] DELETE /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:32:24.114307 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:24.114948 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 30076bb9-d5e3-4879-a723-e8a07b26004f] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:24.123458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:24.123941 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:24.124470 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:24.125167 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:24.125622 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:24.126049 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:24.139089 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] HTTP exception thrown: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Request method failure captured: Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f HTTP/1.1 Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Qu-SHpcC2DUXWVl-VVD4lBPSU77T5_xatPlv5sK3vjiODwnGRiyHnxs-RU1A82XT2Pe9dqQD-jLNQcHoJpLXWc-x6-lDO4MsdmeZjxEBNSu51Xy72q2k4o4wz9thR-sBcySJ3A3vgxWoVwKy3ZjBkJkIonrhdL1VX82lV6pOhkCZo Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:32:24.141263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0679691b1c674dc4968638b8a93d4858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 66df80c268094c48abf73f1323aa23de Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.143260 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '30076bb9-d5e3-4879-a723-e8a07b26004f'} Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:32:24.144527 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. Sep 06 16:32:24.146278 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:24.147903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Returning 404 to user: Instance 30076bb9-d5e3-4879-a723-e8a07b26004f could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:32:24.147903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7e7b5fbf-ed39-4d49-b92a-31be2c07dd53 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f" status: 404 len: 111 microversion: 2.20 time: 0.032738 Sep 06 16:32:24.147903 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 632/1327] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:32:24 2022] GET /compute/v2.1/servers/30076bb9-d5e3-4879-a723-e8a07b26004f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:32:25.283584 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:25.284117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:25.290524 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:25.291053 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:25.291492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:25.292180 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:25.292632 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:25.293101 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:25.312300 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] HTTP exception thrown: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Request method failure captured: Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b HTTP/1.1 Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3Qu-SHpcC2DUXWVl-VVD4lBPSU77T5_xatPlv5sK3vjiODwnGRiyHnxs-RU1A82XT2Pe9dqQD-jLNQcHoJpLXWc-x6-lDO4MsdmeZjxEBNSu51Xy72q2k4o4wz9thR-sBcySJ3A3vgxWoVwKy3ZjBkJkIonrhdL1VX82lV6pOhkCZo Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:32:25.313925 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0679691b1c674dc4968638b8a93d4858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 66df80c268094c48abf73f1323aa23de Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.315570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '2891ad36-504d-4c32-a783-6d93e3a4b43b'} Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:32:25.316734 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.318331 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.320104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Returning 404 to user: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:32:25.320104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c03095f3-d358-4bf4-89e0-18157d605938 tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 404 len: 111 microversion: 2.20 time: 0.036283 Sep 06 16:32:25.320104 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 696/1328] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Sep 6 16:32:25 2022] DELETE /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:32:25.324035 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:25.324699 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] [instance: 2891ad36-504d-4c32-a783-6d93e3a4b43b] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:25.332079 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:25.332561 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:25.332998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:25.333995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:25.334446 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:25.334901 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:25.349436 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] HTTP exception thrown: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Request method failure captured: Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b HTTP/1.1 Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3Qu-SHpcC2DUXWVl-VVD4lBPSU77T5_xatPlv5sK3vjiODwnGRiyHnxs-RU1A82XT2Pe9dqQD-jLNQcHoJpLXWc-x6-lDO4MsdmeZjxEBNSu51Xy72q2k4o4wz9thR-sBcySJ3A3vgxWoVwKy3ZjBkJkIonrhdL1VX82lV6pOhkCZo Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:32:25.351063 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0679691b1c674dc4968638b8a93d4858"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0679691b1c674dc4968638b8a93d4858"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 0679691b1c674dc4968638b8a93d4858 Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-976784177 Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 66df80c268094c48abf73f1323aa23de Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-AttachVolumeShelveTestJSON-976784177-project Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.352888 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '2891ad36-504d-4c32-a783-6d93e3a4b43b'} Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:32:25.353862 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. Sep 06 16:32:25.355583 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:32:25.357238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] Returning 404 to user: Instance 2891ad36-504d-4c32-a783-6d93e3a4b43b could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:32:25.357238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-a52f7121-39b1-4292-b3a1-1541aac1badf tempest-AttachVolumeShelveTestJSON-976784177 tempest-AttachVolumeShelveTestJSON-976784177-project] 10.222.0.26 "GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b" status: 404 len: 111 microversion: 2.20 time: 0.032315 Sep 06 16:32:25.357238 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 633/1329] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 6 16:32:25 2022] GET /compute/v2.1/servers/2891ad36-504d-4c32-a783-6d93e3a4b43b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 16:32:52.047407 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-801543571", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-212657060", "security_groups": [{"name": "tempest-secgroup-smoke-1209426615"}], "block_device_mapping_v2": [{"uuid": "b510241e-1fd3-4299-9f84-4209f1b07222", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8447cde-2775-41af-9b27-fe16e441705f"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:32:52.060266 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:52.060917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:52.173081 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] validate_networks() for [('e8447cde-2775-41af-9b27-fe16e441705f', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 16:32:52.655111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 16:32:52.655530 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 16:32:52.655999 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 16:32:52.656400 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 16:32:52.656805 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 16:32:52.666007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:52.666473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:52.666937 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:52.667647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:52.668090 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:52.668503 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:52.685381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 16:32:52.689317 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Getting quotas for user 210d0f461d2c445a9688bc233d048079 and project 870b3a5a8fc74957bf004f0a6f6020a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 16:32:52.750201 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 16:32:52.752349 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b510241e-1fd3-4299-9f84-4209f1b07222',volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 16:32:52.885965 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-efbbbbe3-4af7-4947-9a30-008bbfc6fcb3 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842539 Sep 06 16:32:52.886639 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 697/1330] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 6 16:32:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 16:32:52.898539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b13f1e25-39bc-416e-9dfb-951a19a2a9d8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:52.898539 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b13f1e25-39bc-416e-9dfb-951a19a2a9d8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:52.900942 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:52.901648 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=30 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:32:52.959016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b13f1e25-39bc-416e-9dfb-951a19a2a9d8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:52.966226 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b13f1e25-39bc-416e-9dfb-951a19a2a9d8 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1093 microversion: 2.1 time: 0.072172 Sep 06 16:32:52.966817 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 634/1331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:32:52 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:32:53.990007 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:53.990621 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:53.996793 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:53.997272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:53.997706 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:53.998396 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:53.998898 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:53.999323 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:54.066351 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:54.074286 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1116fce7-0095-439a-8b62-1e3de37df7c5 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1143 microversion: 2.1 time: 0.088774 Sep 06 16:32:54.074916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 698/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:32:53 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:32:55.098206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:55.098882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:55.105296 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:55.105777 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:55.106221 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:55.106943 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:55.107406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:55.107832 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:55.169810 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:55.177790 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-8baf201a-437e-4b91-90fb-19ccda57e6f4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1143 microversion: 2.1 time: 0.084251 Sep 06 16:32:55.178356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 635/1333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:32:55 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:32:56.200371 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:56.201015 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:56.207703 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:56.208187 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:56.208624 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:56.209576 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:56.210021 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:56.210446 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:56.272311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:56.280335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-20c709ec-fbbc-4241-8656-350fa0c0dd10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1191 microversion: 2.1 time: 0.083731 Sep 06 16:32:56.280922 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 699/1334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:32:56 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:32:57.304708 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:57.305310 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:57.311804 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:57.312283 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:57.312733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:57.313429 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:57.313429 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:57.313429 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:57.390407 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:57.398797 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-c6637917-e96f-40e2-9f8a-37a3a04d606d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1209 microversion: 2.1 time: 0.097898 Sep 06 16:32:57.399370 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 636/1335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:32:57 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:32:58.423296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:58.423916 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:58.427021 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-75524cf7-9ded-43e1-bd27-012fba907ec2 req-a3efbae6-998c-4a98-a455-00f11737ab19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24de940-443e-41b5-8c61-a1d191919357", "tag": "a8ac2f15-64ba-42c8-8951-8c399aceb13a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:32:58.431324 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:58.431819 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:58.432263 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:58.432972 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:58.433427 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:58.433858 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:58.446909 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-75524cf7-9ded-43e1-bd27-012fba907ec2 req-a3efbae6-998c-4a98-a455-00f11737ab19 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:58.447449 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-75524cf7-9ded-43e1-bd27-012fba907ec2 req-a3efbae6-998c-4a98-a455-00f11737ab19 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:58.447895 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-75524cf7-9ded-43e1-bd27-012fba907ec2 req-a3efbae6-998c-4a98-a455-00f11737ab19 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:58.462187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-75524cf7-9ded-43e1-bd27-012fba907ec2 req-a3efbae6-998c-4a98-a455-00f11737ab19 service nova] Creating event network-changed:a8ac2f15-64ba-42c8-8951-8c399aceb13a for instance b24de940-443e-41b5-8c61-a1d191919357 on hv-cinder-85220 Sep 06 16:32:58.467382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-75524cf7-9ded-43e1-bd27-012fba907ec2 req-a3efbae6-998c-4a98-a455-00f11737ab19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045444 Sep 06 16:32:58.468235 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 637/1336] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:32:58.575774 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:58.583647 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5cd54944-ae93-4f5c-aa4c-ea89230f5ef4 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.164334 Sep 06 16:32:58.584216 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 700/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:32:58 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:32:59.608651 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:32:59.609347 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:32:59.615826 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:59.616303 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:59.616739 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:59.617424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:32:59.617876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:32:59.618298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:32:59.758594 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:32:59.766397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0bb77858-d5ce-4548-9262-012df5eb38f1 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.162425 Sep 06 16:32:59.766995 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 638/1338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:32:59 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:00.790103 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:00.790653 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:00.797127 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:00.797610 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:00.798049 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:00.798773 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:00.799225 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:00.799667 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:00.933570 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:00.941372 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6aa6660b-f1cf-430e-87e5-5231989f8738 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.155254 Sep 06 16:33:00.941942 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 701/1339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:00 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:33:01.964863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:01.965399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:01.971538 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:01.972187 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:01.972640 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:01.973319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:01.973774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:01.974201 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:02.104856 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:02.113686 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-ad1fc3f4-37de-47a7-972e-c28ce6e08401 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.152947 Sep 06 16:33:02.114282 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 639/1340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:01 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:03.136901 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:03.137498 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:03.139802 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:03.140473 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:03.147239 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:03.147727 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:03.148159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:03.148865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:03.149360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:03.149824 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:03.290588 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:03.298272 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5eb2f7df-578a-4979-8a93-a39b27e917ed tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.165263 Sep 06 16:33:03.298857 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 702/1341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:03 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:04.322534 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:04.323166 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:04.325628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell0:SELECT=2 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:33:04.331346 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:04.332344 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:04.332783 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:04.333483 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:04.333931 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:04.334356 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:04.473280 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:04.481029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-2a7b0b9a-dffe-411d-be9f-0dcc2715bcbe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.162333 Sep 06 16:33:04.481599 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 640/1342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:04 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:05.506265 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:05.506897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:05.512839 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:05.513314 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:05.513747 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:05.514442 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:05.514907 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:05.515327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:05.652231 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:05.660716 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ac9a6b42-1690-4164-a1a8-e768f6a3cf42 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.159590 Sep 06 16:33:05.661295 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 703/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:05 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:06.683612 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:06.684220 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:06.691211 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:06.691763 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:06.692207 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:06.692897 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:06.693372 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:06.693801 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:06.836472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:06.844320 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-d66930cf-2a70-4ac8-9678-c423b7510132 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.164494 Sep 06 16:33:06.845067 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 641/1344] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:06 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:07.868258 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:07.868873 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:07.875540 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:07.876019 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:07.876457 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:07.877161 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:07.877611 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:07.878951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:08.015131 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:08.023855 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5db13214-5b4c-48e1-97c5-c48edc44f2ca tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.159459 Sep 06 16:33:08.024426 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 704/1345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:07 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:09.047357 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:09.047911 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:09.055114 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:09.055602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:09.056051 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:09.056749 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:09.057206 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:09.057642 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:09.196573 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:09.204369 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-818f8f77-0fcd-4c30-adff-3d8a672291b2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.160996 Sep 06 16:33:09.204935 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 642/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:09 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:10.227492 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:10.228111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:10.234282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:10.234804 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:10.235250 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:10.235939 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:10.236393 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:10.236818 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:10.370116 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:10.378186 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c0aa17d3-763f-4dda-b898-7e2a9e7fb5bd tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.154724 Sep 06 16:33:10.378772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 705/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:10 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:11.401336 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:11.401922 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:11.408391 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:11.408864 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:11.409298 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:11.409975 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:11.410420 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:11.411523 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:11.568720 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:11.576681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-7f0348ed-f263-4d28-afaa-b45d3b69b8fe tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.179251 Sep 06 16:33:11.577254 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 643/1348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:11 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:12.600661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:12.601282 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:12.607845 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:12.608335 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:12.608772 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:12.609478 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:12.609930 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:12.610366 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:12.744671 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:12.752334 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-00a774ab-0bb1-4a81-9008-a35af645297e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.156225 Sep 06 16:33:12.752890 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 706/1349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:12 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:13.775381 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:13.775952 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:13.782448 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:13.782967 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:13.783406 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:13.784111 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:13.784568 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:13.785000 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:13.918959 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:13.927132 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-fbb2107b-160a-4ebc-b2a4-cc90675f4cff tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.155713 Sep 06 16:33:13.927694 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 644/1350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:13 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:14.949490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:14.950389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:14.956595 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.957078 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.957518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:14.958215 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:14.958682 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:14.959117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:15.090530 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:15.098179 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e42766df-101b-4969-950a-16c30401b683 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.152621 Sep 06 16:33:15.099291 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 707/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:14 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 16:33:15.542090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [req-a1211ba7-f72a-4bdf-8150-1e3c56b219d9 req-0af959d4-3298-4e16-a802-1f1643835b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24de940-443e-41b5-8c61-a1d191919357", "name": "network-vif-plugged", "status": "completed", "tag": "a8ac2f15-64ba-42c8-8951-8c399aceb13a"}]} {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:15.554090 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a1211ba7-f72a-4bdf-8150-1e3c56b219d9 req-0af959d4-3298-4e16-a802-1f1643835b61 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:15.554574 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a1211ba7-f72a-4bdf-8150-1e3c56b219d9 req-0af959d4-3298-4e16-a802-1f1643835b61 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:15.555033 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [req-a1211ba7-f72a-4bdf-8150-1e3c56b219d9 req-0af959d4-3298-4e16-a802-1f1643835b61 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:15.566519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.compute.server_external_events [req-a1211ba7-f72a-4bdf-8150-1e3c56b219d9 req-0af959d4-3298-4e16-a802-1f1643835b61 service nova] Creating event network-vif-plugged:a8ac2f15-64ba-42c8-8951-8c399aceb13a for instance b24de940-443e-41b5-8c61-a1d191919357 on hv-cinder-85220 Sep 06 16:33:15.572871 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [req-a1211ba7-f72a-4bdf-8150-1e3c56b219d9 req-0af959d4-3298-4e16-a802-1f1643835b61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035245 Sep 06 16:33:15.573467 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 645/1352] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:33:16.122373 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:16.123218 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:16.130048 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:16.131657 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:16.132095 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:16.132800 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:16.133253 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:16.133674 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:16.266118 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:16.274271 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e979b282-e797-4f7c-9bd1-8f588f670b10 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.156115 Sep 06 16:33:16.274865 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 708/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:16 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:17.298261 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:17.298998 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:17.305397 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:17.305883 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:17.306319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:17.307047 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:17.307493 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:17.308104 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:17.469908 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:17.478472 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f7e81f6a-f5a2-415d-b9de-8a8282bb7ade tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1265 microversion: 2.1 time: 0.184916 Sep 06 16:33:17.479368 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 646/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:17 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:18.502690 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:18.503311 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:18.510475 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:18.510994 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:18.511604 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:18.512322 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:18.512790 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:18.513195 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:18.655506 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:18.664111 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3bd0fe26-c7fd-4456-b742-9c853e458913 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1452 microversion: 2.1 time: 0.165227 Sep 06 16:33:18.664683 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 709/1355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:18 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:18.687087 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:33:18.687707 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:33:18.694950 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:18.695441 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:18.695876 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:18.696582 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:18.697038 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:18.697464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:18.836519 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:33:18.844176 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f01e545b-f494-4b26-8269-6cc351914a59 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1452 microversion: 2.1 time: 0.161081 Sep 06 16:33:18.844746 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 647/1356] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:33:18 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:33:21.008581 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-56ac5b56-8fcb-48f2-bd88-94da95b2d451 req-a81f492a-4b08-46ec-8a1e-2f941b62b267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24de940-443e-41b5-8c61-a1d191919357", "tag": "a8ac2f15-64ba-42c8-8951-8c399aceb13a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:33:21.020366 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-56ac5b56-8fcb-48f2-bd88-94da95b2d451 req-a81f492a-4b08-46ec-8a1e-2f941b62b267 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:33:21.021806 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-56ac5b56-8fcb-48f2-bd88-94da95b2d451 req-a81f492a-4b08-46ec-8a1e-2f941b62b267 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:33:21.022466 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-56ac5b56-8fcb-48f2-bd88-94da95b2d451 req-a81f492a-4b08-46ec-8a1e-2f941b62b267 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:33:21.034010 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-56ac5b56-8fcb-48f2-bd88-94da95b2d451 req-a81f492a-4b08-46ec-8a1e-2f941b62b267 service nova] Creating event network-changed:a8ac2f15-64ba-42c8-8951-8c399aceb13a for instance b24de940-443e-41b5-8c61-a1d191919357 on hv-cinder-85220 Sep 06 16:33:21.039461 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-56ac5b56-8fcb-48f2-bd88-94da95b2d451 req-a81f492a-4b08-46ec-8a1e-2f941b62b267 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035706 Sep 06 16:33:21.040159 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 710/1357] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 16:35:36.845137 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d2d71b22-1e2e-4bf9-a94a-71ea6785c870] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 06 16:35:36.845744 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_api:SELECT=30 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:35:36.846863 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG dbcounter [-] [120738] Writing DB stats nova_cell1:SELECT=70 {{(pid=120738) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:35:36.847445 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 16:35:36.847602 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Tue Sep 6 16:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 (ip 10.222.0.26) !!! Sep 06 16:35:36.849494 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 16:35:36.849636 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Tue Sep 6 16:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 (ip 10.222.0.26) !!! Sep 06 16:35:36.854281 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7cc2a4b-f59f-4720-b772-fb1d864ca81c] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 16:35:36.856099 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:36.856485 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:35:36.856614 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:36.857359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=76 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 16:35:36.863056 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 16:35:36.863248 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Tue Sep 6 16:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 06 16:35:36.867073 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:36.868971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:36.869428 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:36.870150 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:36.870607 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:36.871064 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:36.871711 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 06 16:35:36.872420 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Tue Sep 6 16:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 06 16:35:36.906565 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:35:36.993508 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-304be50b-6edf-4e2e-b894-5ccfb17ea74a tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 204 len: 0 microversion: 2.1 time: 0.149182 Sep 06 16:35:36.994374 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 648/1358] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:35:36 2022] DELETE /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:35:37.004823 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:37.005601 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:37.013592 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:37.014424 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:37.015062 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:37.015949 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:37.016788 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:37.017399 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:37.140548 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-37ddf43c-b18e-4534-9d8b-52979155af7e req-0dc60663-20ac-4dc7-8ed1-fdd658f05e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24de940-443e-41b5-8c61-a1d191919357", "tag": "a8ac2f15-64ba-42c8-8951-8c399aceb13a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:35:37.151319 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-37ddf43c-b18e-4534-9d8b-52979155af7e req-0dc60663-20ac-4dc7-8ed1-fdd658f05e03 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:37.151996 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-37ddf43c-b18e-4534-9d8b-52979155af7e req-0dc60663-20ac-4dc7-8ed1-fdd658f05e03 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:37.152894 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-37ddf43c-b18e-4534-9d8b-52979155af7e req-0dc60663-20ac-4dc7-8ed1-fdd658f05e03 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:37.164017 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-37ddf43c-b18e-4534-9d8b-52979155af7e req-0dc60663-20ac-4dc7-8ed1-fdd658f05e03 service nova] Creating event network-changed:a8ac2f15-64ba-42c8-8951-8c399aceb13a for instance b24de940-443e-41b5-8c61-a1d191919357 on hv-cinder-85220 Sep 06 16:35:37.170117 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-37ddf43c-b18e-4534-9d8b-52979155af7e req-0dc60663-20ac-4dc7-8ed1-fdd658f05e03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324274 Sep 06 16:35:37.170740 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 711/1359] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:35:37.278182 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:35:37.286204 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-b40880d6-50d1-4d86-be82-c8a6ad5a40d2 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1576 microversion: 2.1 time: 0.287098 Sep 06 16:35:37.287160 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 649/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:36 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:35:38.315884 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7cc2a4b-f59f-4720-b772-fb1d864ca81c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45016. Sep 06 16:35:38.320789 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:38.322750 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:38.329024 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:38.329605 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:38.330107 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:38.330903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:38.331424 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:38.331917 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:38.523065 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:35:38.533054 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2d891a84-2509-4386-a79b-88096931fa5d tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1576 microversion: 2.1 time: 0.225884 Sep 06 16:35:38.533661 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 712/1361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:38 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:35:39.559107 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:39.559733 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:39.566543 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:39.567628 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:39.568076 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:39.568784 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:39.569236 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:39.569661 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:39.589738 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO oslo.messaging._drivers.impl_rabbit [-] [d2d71b22-1e2e-4bf9-a94a-71ea6785c870] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 45026. Sep 06 16:35:40.031020 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:35:40.039070 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-3d5960ef-64de-4f19-9458-e9980ae0dc7f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1576 microversion: 2.1 time: 0.484397 Sep 06 16:35:40.040247 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 650/1362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:39 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1576 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:35:40.320381 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-71a24771-53e5-4436-86ed-bf93d419a8f2 req-e2e2d32b-cb32-44f5-9d86-f2f82e5c11a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24de940-443e-41b5-8c61-a1d191919357", "name": "network-vif-deleted", "tag": "a8ac2f15-64ba-42c8-8951-8c399aceb13a"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:35:40.330881 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-71a24771-53e5-4436-86ed-bf93d419a8f2 req-e2e2d32b-cb32-44f5-9d86-f2f82e5c11a6 service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:40.331360 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-71a24771-53e5-4436-86ed-bf93d419a8f2 req-e2e2d32b-cb32-44f5-9d86-f2f82e5c11a6 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:40.331792 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-71a24771-53e5-4436-86ed-bf93d419a8f2 req-e2e2d32b-cb32-44f5-9d86-f2f82e5c11a6 service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:40.343830 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-71a24771-53e5-4436-86ed-bf93d419a8f2 req-e2e2d32b-cb32-44f5-9d86-f2f82e5c11a6 service nova] Creating event network-vif-deleted:a8ac2f15-64ba-42c8-8951-8c399aceb13a for instance b24de940-443e-41b5-8c61-a1d191919357 on hv-cinder-85220 Sep 06 16:35:40.349109 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-71a24771-53e5-4436-86ed-bf93d419a8f2 req-e2e2d32b-cb32-44f5-9d86-f2f82e5c11a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033873 Sep 06 16:35:40.349813 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 713/1363] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:35:41.063774 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:41.064401 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:41.071462 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:41.072008 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:41.072475 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:41.073179 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:41.073632 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:41.074059 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:41.105464 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:41.105938 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:41.106392 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:41.106866 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lazy-loading 'fault' on Instance uuid b24de940-443e-41b5-8c61-a1d191919357 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:35:41.151337 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:35:41.158951 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-0b8a4799-ce00-42ec-a6f8-47ab6684d7be tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 200 len: 1229 microversion: 2.1 time: 0.099171 Sep 06 16:35:41.159517 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 651/1364] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:41 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:35:42.183566 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:42.184255 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: b24de940-443e-41b5-8c61-a1d191919357] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:42.190456 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:42.190956 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:42.191389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:42.192066 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:42.192508 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:42.192927 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:42.206296 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] HTTP exception thrown: Instance b24de940-443e-41b5-8c61-a1d191919357 could not be found. Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Request method failure captured: Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 HTTP/1.1 Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3S1dZmUtAljM6kOhAXWhZLDYhE3zTuZTZ5fX52-A-6J7HY2OFD5SQomNGwLNKggF2QdGJbmr8038pjSm-ie353Mf5bB98Cs84y6SEM2BH7LBBgXrqsi9hZjDZ2kFQEFk93uuxCuSPLWUaJSMFRsnN6-jE8Ju_zPEnjV1p5R5e_tjEQ Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:35:42.207978 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 210d0f461d2c445a9688bc233d048079 Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance b24de940-443e-41b5-8c61-a1d191919357 could not be found. Sep 06 16:35:42.209609 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'b24de940-443e-41b5-8c61-a1d191919357'} Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b24de940-443e-41b5-8c61-a1d191919357 could not be found. Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:35:42.211870 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b24de940-443e-41b5-8c61-a1d191919357 could not be found. Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b24de940-443e-41b5-8c61-a1d191919357 could not be found. Sep 06 16:35:42.213765 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:42.215389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Returning 404 to user: Instance b24de940-443e-41b5-8c61-a1d191919357 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:35:42.215389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b3d2fd0f-2bb7-49f7-92b4-165a02ed4d0c tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357" status: 404 len: 111 microversion: 2.1 time: 0.030515 Sep 06 16:35:42.215389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 714/1365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:42 2022] GET /compute/v2.1/servers/b24de940-443e-41b5-8c61-a1d191919357 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:35:45.596419 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:45.596972 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:45.598742 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-2985db6b-759b-4efd-8b4d-4f5c9904a91e req-4b330d4e-6139-4316-8c47-0735d99b2c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ee111f-6f13-4bf2-8689-2801820531c7", "tag": "d72505b4-7d71-45c0-b7f6-c83047cebb86"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:35:45.606029 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:45.606767 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:45.607223 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:45.607932 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:45.609255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:45.609255 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:45.611352 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2985db6b-759b-4efd-8b4d-4f5c9904a91e req-4b330d4e-6139-4316-8c47-0735d99b2c8e service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:45.611897 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2985db6b-759b-4efd-8b4d-4f5c9904a91e req-4b330d4e-6139-4316-8c47-0735d99b2c8e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:45.612389 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-2985db6b-759b-4efd-8b4d-4f5c9904a91e req-4b330d4e-6139-4316-8c47-0735d99b2c8e service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:45.625327 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-2985db6b-759b-4efd-8b4d-4f5c9904a91e req-4b330d4e-6139-4316-8c47-0735d99b2c8e service nova] Creating event network-changed:d72505b4-7d71-45c0-b7f6-c83047cebb86 for instance c5ee111f-6f13-4bf2-8689-2801820531c7 on hv-cinder-85220 Sep 06 16:35:45.630686 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-2985db6b-759b-4efd-8b4d-4f5c9904a91e req-4b330d4e-6139-4316-8c47-0735d99b2c8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036268 Sep 06 16:35:45.631691 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 715/1366] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:35:45.639362 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Going to try to terminate instance {{(pid=120738) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 16:35:45.732882 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-30ad8697-053c-4344-81a1-4ac42f6dc842 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 204 len: 0 microversion: 2.1 time: 0.140606 Sep 06 16:35:45.734016 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 652/1367] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:35:45 2022] DELETE /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 16:35:45.744309 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:45.745559 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:45.755027 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:45.755511 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:45.755941 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:45.756782 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:45.757477 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:45.757903 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:45.909359 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:35:45.917293 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8dece702-6f7c-40b3-b47b-1fb8425e4d8f tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1578 microversion: 2.1 time: 0.178237 Sep 06 16:35:45.918070 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 716/1368] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:45 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:35:46.941676 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:46.942382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:46.949758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:46.950242 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:46.950715 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:46.951426 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:46.951878 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:46.952315 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:47.177590 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:35:47.186353 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-88355c20-fbf2-4a5a-a0e7-3bd7949497db tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1459 microversion: 2.1 time: 0.248785 Sep 06 16:35:47.186978 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 653/1369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:46 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1459 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:35:47.647217 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-d7978655-8e8b-4716-8c4a-e62eca6fd70d req-bd9630c6-9635-4bc1-8a9f-f397dc216dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ee111f-6f13-4bf2-8689-2801820531c7", "name": "network-vif-deleted", "tag": "d72505b4-7d71-45c0-b7f6-c83047cebb86"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 16:35:47.658616 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d7978655-8e8b-4716-8c4a-e62eca6fd70d req-bd9630c6-9635-4bc1-8a9f-f397dc216dcf service nova] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:47.659199 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d7978655-8e8b-4716-8c4a-e62eca6fd70d req-bd9630c6-9635-4bc1-8a9f-f397dc216dcf service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:47.659628 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d7978655-8e8b-4716-8c4a-e62eca6fd70d req-bd9630c6-9635-4bc1-8a9f-f397dc216dcf service nova] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:47.673602 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-d7978655-8e8b-4716-8c4a-e62eca6fd70d req-bd9630c6-9635-4bc1-8a9f-f397dc216dcf service nova] Creating event network-vif-deleted:d72505b4-7d71-45c0-b7f6-c83047cebb86 for instance c5ee111f-6f13-4bf2-8689-2801820531c7 on hv-cinder-85220 Sep 06 16:35:47.678618 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-d7978655-8e8b-4716-8c4a-e62eca6fd70d req-bd9630c6-9635-4bc1-8a9f-f397dc216dcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Sep 06 16:35:47.678992 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 717/1370] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 6 16:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 16:35:48.211152 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:48.212043 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:48.218834 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:48.219319 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:48.219758 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:48.220453 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:48.220902 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:48.221329 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:48.257681 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:48.258252 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:48.259487 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:48.260115 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.objects.instance [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lazy-loading 'fault' on Instance uuid c5ee111f-6f13-4bf2-8689-2801820531c7 {{(pid=120738) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 16:35:48.307263 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.policy [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210d0f461d2c445a9688bc233d048079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870b3a5a8fc74957bf004f0a6f6020a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120738) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 16:35:48.314382 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-07d158de-bf4a-4d5e-a96b-164862f87940 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 200 len: 1183 microversion: 2.1 time: 0.107019 Sep 06 16:35:48.314987 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 654/1371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:48 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 1183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 16:35:49.339823 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:49.340608 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: c5ee111f-6f13-4bf2-8689-2801820531c7] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:49.346951 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:49.347438 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:49.347877 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:49.348569 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:49.349025 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:49.349451 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:49.362977 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] HTTP exception thrown: Instance c5ee111f-6f13-4bf2-8689-2801820531c7 could not be found. Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Request method failure captured: Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 HTTP/1.1 Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3S1dZmUtAljM6kOhAXWhZLDYhE3zTuZTZ5fX52-A-6J7HY2OFD5SQomNGwLNKggF2QdGJbmr8038pjSm-ie353Mf5bB98Cs84y6SEM2BH7LBBgXrqsi9hZjDZ2kFQEFk93uuxCuSPLWUaJSMFRsnN6-jE8Ju_zPEnjV1p5R5e_tjEQ Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:35:49.364633 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 210d0f461d2c445a9688bc233d048079 Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance c5ee111f-6f13-4bf2-8689-2801820531c7 could not be found. Sep 06 16:35:49.366436 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': 'c5ee111f-6f13-4bf2-8689-2801820531c7'} Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ee111f-6f13-4bf2-8689-2801820531c7 could not be found. Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:35:49.367673 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ee111f-6f13-4bf2-8689-2801820531c7 could not be found. Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ee111f-6f13-4bf2-8689-2801820531c7 could not be found. Sep 06 16:35:49.369388 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.371122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Returning 404 to user: Instance c5ee111f-6f13-4bf2-8689-2801820531c7 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:35:49.371122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d53cc273-d24a-4cb4-8df1-be7cb302590e tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7" status: 404 len: 111 microversion: 2.1 time: 0.031887 Sep 06 16:35:49.371122 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 718/1372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:49 2022] GET /compute/v2.1/servers/c5ee111f-6f13-4bf2-8689-2801820531c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:35:49.817471 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:49.818010 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.compute.api [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120738) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:49.825036 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:49.825525 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:49.825971 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:49.826688 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:49.827145 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:49.827571 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG oslo_concurrency.lockutils [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120738) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:49.841248 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.wsgi [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] HTTP exception thrown: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Request method failure captured: Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: request: DELETE /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 HTTP/1.1 Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept: application/json Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Accept-Encoding: identity Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Connection: close Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Length: 0 Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Content-Type: application/json Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Host: 10.222.0.26 Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: Openstack-System-Scope: None Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: User-Agent: python-urllib3/1.26.12 Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Auth-Token: gAAAAABjF3S1dZmUtAljM6kOhAXWhZLDYhE3zTuZTZ5fX52-A-6J7HY2OFD5SQomNGwLNKggF2QdGJbmr8038pjSm-ie353Mf5bB98Cs84y6SEM2BH7LBBgXrqsi9hZjDZ2kFQEFk93uuxCuSPLWUaJSMFRsnN6-jE8Ju_zPEnjV1p5R5e_tjEQ Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Id: None Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Domain-Name: None Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Identity-Status: Confirmed Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Is-Admin-Project: True Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Id: default Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Domain-Name: Default Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Project-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Role: member,reader Sep 06 16:35:49.843018 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Roles: member,reader Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-Tenant-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Id: default Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Domain-Name: Default Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Id: 210d0f461d2c445a9688bc233d048079 Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: X-User-Name: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: method: > Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: exception: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.844830 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: action_args: {'id': '6e4e8266-0821-4d32-98eb-be879841b7c2'} Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:35:49.845894 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.847572 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.849458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Returning 404 to user: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. {{(pid=120738) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:35:49.849458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-f61e8983-9119-43c7-8fb6-6438f04bdc69 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 404 len: 111 microversion: 2.1 time: 0.030907 Sep 06 16:35:49.849458 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 655/1373] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 6 16:35:49 2022] DELETE /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:35:49.853947 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:49.854518 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] [instance: 6e4e8266-0821-4d32-98eb-be879841b7c2] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 16:35:49.860440 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:49.860914 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:49.861910 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:49.862037 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Acquiring lock "e869643c-c539-4de1-8cc0-80684df9a8fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 16:35:49.862450 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 16:35:49.862905 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Lock "e869643c-c539-4de1-8cc0-80684df9a8fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 16:35:49.876648 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] HTTP exception thrown: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Request method failure captured: Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 HTTP/1.1 Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept: application/json Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Connection: close Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Length: 0 Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Content-Type: application/json Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Host: 10.222.0.26 Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjF3S1dZmUtAljM6kOhAXWhZLDYhE3zTuZTZ5fX52-A-6J7HY2OFD5SQomNGwLNKggF2QdGJbmr8038pjSm-ie353Mf5bB98Cs84y6SEM2BH7LBBgXrqsi9hZjDZ2kFQEFk93uuxCuSPLWUaJSMFRsnN6-jE8Ju_zPEnjV1p5R5e_tjEQ Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Role: member,reader Sep 06 16:35:49.878182 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/870b3a5a8fc74957bf004f0a6f6020a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}] Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 870b3a5a8fc74957bf004f0a6f6020a3 Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestVolumeBootPattern-1141533605 Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Id: 210d0f461d2c445a9688bc233d048079 Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestVolumeBootPattern-1141533605-project Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: method: > Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: exception: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.879989 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: action_args: {'id': '6e4e8266-0821-4d32-98eb-be879841b7c2'} Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 16:35:49.881093 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. Sep 06 16:35:49.882817 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Sep 06 16:35:49.885490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Returning 404 to user: Instance 6e4e8266-0821-4d32-98eb-be879841b7c2 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 16:35:49.885490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-90f7ab61-9385-4203-8a4f-c2edf035aba0 tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2" status: 404 len: 111 microversion: 2.1 time: 0.030279 Sep 06 16:35:49.885490 dv-cinder-852208-18-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 719/1374] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 6 16:35:49 2022] GET /compute/v2.1/servers/6e4e8266-0821-4d32-98eb-be879841b7c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 16:35:51.180669 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: DEBUG nova.api.openstack.wsgi [None req-9ce0e0b7-4535-4ce7-9ad7-ebbf25bb28ec tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] Calling method '.version_select at 0x7f21b3ff93a0>' {{(pid=120738) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 16:35:51.204170 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: INFO nova.api.openstack.requestlog [None req-9ce0e0b7-4535-4ce7-9ad7-ebbf25bb28ec tempest-TestVolumeBootPattern-1141533605 tempest-TestVolumeBootPattern-1141533605-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-212657060" status: 202 len: 0 microversion: 2.1 time: 0.027775 Sep 06 16:35:51.208459 dv-cinder-852208-18-iscsi devstack@n-api.service[120738]: [pid: 120738|app: 0|req: 656/1375] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Sep 6 16:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-212657060 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)